[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251215 20:51:09.876977 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:36099
I20251215 20:51:09.878971 426 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 20:51:09.880373 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:51:09.896586 433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:09.897243 432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:09.898236 426 server_base.cc:1047] running on GCE node
W20251215 20:51:09.897758 435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:10.990517 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:51:10.990757 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:51:10.990945 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831870990924 us; error 0 us; skew 500 ppm
I20251215 20:51:10.991751 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:51:10.996814 426 webserver.cc:492] Webserver started at http://127.0.106.190:38915/ using document root <none> and password file <none>
I20251215 20:51:10.997628 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:51:10.997830 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:51:10.998247 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:51:11.004403 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/master-0-root/instance:
uuid: "205f885235ea4ffdb5f81c48462e1536"
format_stamp: "Formatted at 2025-12-15 20:51:10 on dist-test-slave-xp5d"
I20251215 20:51:11.011656 426 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20251215 20:51:11.016583 441 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.018152 426 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20251215 20:51:11.018465 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/master-0-root
uuid: "205f885235ea4ffdb5f81c48462e1536"
format_stamp: "Formatted at 2025-12-15 20:51:10 on dist-test-slave-xp5d"
I20251215 20:51:11.018803 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:51:11.064774 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:51:11.066324 426 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 20:51:11.066751 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:51:11.142509 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:36099
I20251215 20:51:11.142599 492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:36099 every 8 connection(s)
I20251215 20:51:11.150012 493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:11.171149 493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536: Bootstrap starting.
I20251215 20:51:11.176744 493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:11.178347 493 log.cc:826] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536: Log is configured to *not* fsync() on all Append() calls
I20251215 20:51:11.182667 493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536: No bootstrap required, opened a new log
I20251215 20:51:11.202979 493 raft_consensus.cc:359] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205f885235ea4ffdb5f81c48462e1536" member_type: VOTER }
I20251215 20:51:11.203498 493 raft_consensus.cc:385] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:11.203689 493 raft_consensus.cc:740] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 205f885235ea4ffdb5f81c48462e1536, State: Initialized, Role: FOLLOWER
I20251215 20:51:11.204412 493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205f885235ea4ffdb5f81c48462e1536" member_type: VOTER }
I20251215 20:51:11.204895 493 raft_consensus.cc:399] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251215 20:51:11.205127 493 raft_consensus.cc:493] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251215 20:51:11.205395 493 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:11.209542 493 raft_consensus.cc:515] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205f885235ea4ffdb5f81c48462e1536" member_type: VOTER }
I20251215 20:51:11.210167 493 leader_election.cc:304] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 205f885235ea4ffdb5f81c48462e1536; no voters:
I20251215 20:51:11.212090 493 leader_election.cc:290] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251215 20:51:11.212436 496 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:11.214968 496 raft_consensus.cc:697] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 1 LEADER]: Becoming Leader. State: Replica: 205f885235ea4ffdb5f81c48462e1536, State: Running, Role: LEADER
I20251215 20:51:11.215754 496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205f885235ea4ffdb5f81c48462e1536" member_type: VOTER }
I20251215 20:51:11.217288 493 sys_catalog.cc:565] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [sys.catalog]: configured and running, proceeding with master startup.
I20251215 20:51:11.226933 497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "205f885235ea4ffdb5f81c48462e1536" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205f885235ea4ffdb5f81c48462e1536" member_type: VOTER } }
I20251215 20:51:11.226979 498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 205f885235ea4ffdb5f81c48462e1536. Latest consensus state: current_term: 1 leader_uuid: "205f885235ea4ffdb5f81c48462e1536" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "205f885235ea4ffdb5f81c48462e1536" member_type: VOTER } }
I20251215 20:51:11.227605 497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [sys.catalog]: This master's current role is: LEADER
I20251215 20:51:11.227681 498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [sys.catalog]: This master's current role is: LEADER
I20251215 20:51:11.231117 504 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251215 20:51:11.243775 504 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251215 20:51:11.245780 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251215 20:51:11.258798 504 catalog_manager.cc:1357] Generated new cluster ID: 27396977de554716a21d3b8ee4a9aeec
I20251215 20:51:11.259093 504 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251215 20:51:11.277392 504 catalog_manager.cc:1380] Generated new certificate authority record
I20251215 20:51:11.279358 504 catalog_manager.cc:1514] Loading token signing keys...
I20251215 20:51:11.296849 504 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536: Generated new TSK 0
I20251215 20:51:11.297756 504 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251215 20:51:11.317008 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:51:11.326810 515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:11.327721 516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:11.331303 426 server_base.cc:1047] running on GCE node
W20251215 20:51:11.332093 518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:11.332912 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:51:11.333115 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:51:11.333269 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831871333252 us; error 0 us; skew 500 ppm
I20251215 20:51:11.333815 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:51:11.338100 426 webserver.cc:492] Webserver started at http://127.0.106.129:45363/ using document root <none> and password file <none>
I20251215 20:51:11.338583 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:51:11.338760 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:51:11.339030 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:51:11.340091 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-0-root/instance:
uuid: "d73987d0b39f4d0593c0d7849e139e28"
format_stamp: "Formatted at 2025-12-15 20:51:11 on dist-test-slave-xp5d"
I20251215 20:51:11.345870 426 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20251215 20:51:11.350481 523 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.351240 426 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20251215 20:51:11.351500 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-0-root
uuid: "d73987d0b39f4d0593c0d7849e139e28"
format_stamp: "Formatted at 2025-12-15 20:51:11 on dist-test-slave-xp5d"
I20251215 20:51:11.351804 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:51:11.372722 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:51:11.373904 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:51:11.376780 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:51:11.381418 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:51:11.381636 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.381894 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:51:11.382057 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.487517 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:36641
I20251215 20:51:11.487634 585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:36641 every 8 connection(s)
I20251215 20:51:11.495241 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:51:11.510563 590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:11.515448 591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:11.525056 593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:11.526793 426 server_base.cc:1047] running on GCE node
I20251215 20:51:11.527750 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:51:11.528074 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:51:11.528322 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831871528278 us; error 0 us; skew 500 ppm
I20251215 20:51:11.529137 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:51:11.532927 426 webserver.cc:492] Webserver started at http://127.0.106.130:37405/ using document root <none> and password file <none>
I20251215 20:51:11.533293 586 heartbeater.cc:344] Connected to a master server at 127.0.106.190:36099
I20251215 20:51:11.533582 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:51:11.533789 586 heartbeater.cc:461] Registering TS with master...
I20251215 20:51:11.533847 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:51:11.534291 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:51:11.535018 586 heartbeater.cc:507] Master 127.0.106.190:36099 requested a full tablet report, sending...
I20251215 20:51:11.535830 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-1-root/instance:
uuid: "6b027efaf85440c49a962daf569191f5"
format_stamp: "Formatted at 2025-12-15 20:51:11 on dist-test-slave-xp5d"
I20251215 20:51:11.538506 458 ts_manager.cc:194] Registered new tserver with Master: d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641)
I20251215 20:51:11.541817 458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52896
I20251215 20:51:11.543488 426 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.000s sys 0.006s
I20251215 20:51:11.549072 598 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.549854 426 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20251215 20:51:11.550163 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-1-root
uuid: "6b027efaf85440c49a962daf569191f5"
format_stamp: "Formatted at 2025-12-15 20:51:11 on dist-test-slave-xp5d"
I20251215 20:51:11.550486 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:51:11.590911 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:51:11.592518 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:51:11.595333 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:51:11.599243 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:51:11.599507 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.599790 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:51:11.600009 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.695765 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:42463
I20251215 20:51:11.695825 660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:42463 every 8 connection(s)
I20251215 20:51:11.704033 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:51:11.714740 664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:11.717175 661 heartbeater.cc:344] Connected to a master server at 127.0.106.190:36099
I20251215 20:51:11.717530 661 heartbeater.cc:461] Registering TS with master...
I20251215 20:51:11.719398 661 heartbeater.cc:507] Master 127.0.106.190:36099 requested a full tablet report, sending...
I20251215 20:51:11.722272 458 ts_manager.cc:194] Registered new tserver with Master: 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:11.724061 458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52900
W20251215 20:51:11.726665 667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:11.727636 665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:11.729950 426 server_base.cc:1047] running on GCE node
I20251215 20:51:11.730803 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:51:11.731002 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:51:11.731160 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831871731143 us; error 0 us; skew 500 ppm
I20251215 20:51:11.731627 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:51:11.733986 426 webserver.cc:492] Webserver started at http://127.0.106.131:33069/ using document root <none> and password file <none>
I20251215 20:51:11.734491 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:51:11.734674 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:51:11.734911 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:51:11.735973 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-2-root/instance:
uuid: "a5c532b76e95438e954f519e3d864b63"
format_stamp: "Formatted at 2025-12-15 20:51:11 on dist-test-slave-xp5d"
I20251215 20:51:11.740271 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20251215 20:51:11.743397 672 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.744222 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20251215 20:51:11.744647 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-2-root
uuid: "a5c532b76e95438e954f519e3d864b63"
format_stamp: "Formatted at 2025-12-15 20:51:11 on dist-test-slave-xp5d"
I20251215 20:51:11.745034 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1765831869714107-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:51:11.757882 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:51:11.759001 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:51:11.760596 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:51:11.763691 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:51:11.763994 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:11.764252 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:51:11.764446 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20251215 20:51:11.852126 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:43957
I20251215 20:51:11.852802 734 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:43957 every 8 connection(s)
I20251215 20:51:11.868495 735 heartbeater.cc:344] Connected to a master server at 127.0.106.190:36099
I20251215 20:51:11.868830 735 heartbeater.cc:461] Registering TS with master...
I20251215 20:51:11.869586 735 heartbeater.cc:507] Master 127.0.106.190:36099 requested a full tablet report, sending...
I20251215 20:51:11.871878 458 ts_manager.cc:194] Registered new tserver with Master: a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:11.872674 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013114476s
I20251215 20:51:11.873574 458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52904
I20251215 20:51:11.876744 426 test_util.cc:276] Using random seed: -982200719
I20251215 20:51:11.932665 458 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52910:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 20:51:11.937438 458 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 20:51:12.054394 623 tablet_service.cc:1505] Processing CreateTablet for tablet a206c3b38086435b9b3b4287cdc724b9 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:51:12.053036 626 tablet_service.cc:1505] Processing CreateTablet for tablet 6891a5cf3c1541438fcb9ee69c50d4f5 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:51:12.054224 625 tablet_service.cc:1505] Processing CreateTablet for tablet 07d9fca6769e426c96573179099e83d7 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:51:12.058729 623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a206c3b38086435b9b3b4287cdc724b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.054893 624 tablet_service.cc:1505] Processing CreateTablet for tablet 23ad144d06c24c768af1bb06f9a54708 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:51:12.059234 622 tablet_service.cc:1505] Processing CreateTablet for tablet fd9c4d0c19bd4c4e8a89c44149cbee31 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:51:12.060034 625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d9fca6769e426c96573179099e83d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.065161 626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891a5cf3c1541438fcb9ee69c50d4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.065789 622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9c4d0c19bd4c4e8a89c44149cbee31. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.068059 550 tablet_service.cc:1505] Processing CreateTablet for tablet 07d9fca6769e426c96573179099e83d7 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:51:12.071524 551 tablet_service.cc:1505] Processing CreateTablet for tablet 6891a5cf3c1541438fcb9ee69c50d4f5 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:51:12.073704 549 tablet_service.cc:1505] Processing CreateTablet for tablet 23ad144d06c24c768af1bb06f9a54708 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:51:12.077708 547 tablet_service.cc:1505] Processing CreateTablet for tablet fd9c4d0c19bd4c4e8a89c44149cbee31 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:51:12.075973 548 tablet_service.cc:1505] Processing CreateTablet for tablet a206c3b38086435b9b3b4287cdc724b9 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:51:12.079391 551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891a5cf3c1541438fcb9ee69c50d4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.081207 549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ad144d06c24c768af1bb06f9a54708. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.075816 624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ad144d06c24c768af1bb06f9a54708. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.082410 547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9c4d0c19bd4c4e8a89c44149cbee31. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.083021 548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a206c3b38086435b9b3b4287cdc724b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.083626 550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d9fca6769e426c96573179099e83d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.114580 621 tablet_service.cc:1505] Processing CreateTablet for tablet 128c79ee45ee4f648ef464e5868728cb (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:51:12.116262 621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128c79ee45ee4f648ef464e5868728cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.122277 546 tablet_service.cc:1505] Processing CreateTablet for tablet 128c79ee45ee4f648ef464e5868728cb (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:51:12.132014 545 tablet_service.cc:1505] Processing CreateTablet for tablet 467ddb6bd57f48aab730f65c83ac0284 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:51:12.140455 546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128c79ee45ee4f648ef464e5868728cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.145171 545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467ddb6bd57f48aab730f65c83ac0284. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.167148 699 tablet_service.cc:1505] Processing CreateTablet for tablet 07d9fca6769e426c96573179099e83d7 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:51:12.169509 699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d9fca6769e426c96573179099e83d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.174046 700 tablet_service.cc:1505] Processing CreateTablet for tablet 6891a5cf3c1541438fcb9ee69c50d4f5 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:51:12.188025 700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891a5cf3c1541438fcb9ee69c50d4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.185312 620 tablet_service.cc:1505] Processing CreateTablet for tablet 467ddb6bd57f48aab730f65c83ac0284 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:51:12.187984 698 tablet_service.cc:1505] Processing CreateTablet for tablet 23ad144d06c24c768af1bb06f9a54708 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:51:12.199645 697 tablet_service.cc:1505] Processing CreateTablet for tablet a206c3b38086435b9b3b4287cdc724b9 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:51:12.201541 620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467ddb6bd57f48aab730f65c83ac0284. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.203651 698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ad144d06c24c768af1bb06f9a54708. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.204860 697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a206c3b38086435b9b3b4287cdc724b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.214078 695 tablet_service.cc:1505] Processing CreateTablet for tablet 128c79ee45ee4f648ef464e5868728cb (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:51:12.215634 695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128c79ee45ee4f648ef464e5868728cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.217454 696 tablet_service.cc:1505] Processing CreateTablet for tablet fd9c4d0c19bd4c4e8a89c44149cbee31 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:51:12.218611 696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9c4d0c19bd4c4e8a89c44149cbee31. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.229516 694 tablet_service.cc:1505] Processing CreateTablet for tablet 467ddb6bd57f48aab730f65c83ac0284 (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:51:12.231163 694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467ddb6bd57f48aab730f65c83ac0284. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:51:12.240633 506 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:51:12.271834 544 tablet_service.cc:1505] Processing CreateTablet for tablet 33a15ec522a14ad3bc4da7093b3e959e (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:51:12.274109 544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a15ec522a14ad3bc4da7093b3e959e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.278321 623 tablet_service.cc:1505] Processing CreateTablet for tablet 33a15ec522a14ad3bc4da7093b3e959e (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:51:12.276654 753 tablet_bootstrap.cc:492] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:12.289813 754 tablet_bootstrap.cc:492] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:12.321000 623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a15ec522a14ad3bc4da7093b3e959e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.337392 693 tablet_service.cc:1505] Processing CreateTablet for tablet 33a15ec522a14ad3bc4da7093b3e959e (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:51:12.340821 693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a15ec522a14ad3bc4da7093b3e959e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.369863 551 tablet_service.cc:1505] Processing CreateTablet for tablet 1445c97060d34de8b8037a3f1d38172b (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:51:12.373090 551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1445c97060d34de8b8037a3f1d38172b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.373189 619 tablet_service.cc:1505] Processing CreateTablet for tablet 1445c97060d34de8b8037a3f1d38172b (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:51:12.375465 619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1445c97060d34de8b8037a3f1d38172b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.375548 696 tablet_service.cc:1505] Processing CreateTablet for tablet 1445c97060d34de8b8037a3f1d38172b (DEFAULT_TABLE table=test-workload [id=1e122a03b2de4b27a0f807a3dd46f196]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:51:12.377506 696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1445c97060d34de8b8037a3f1d38172b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:12.382329 755 tablet_bootstrap.cc:492] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:12.415409 754 tablet_bootstrap.cc:654] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.431902 755 tablet_bootstrap.cc:654] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.433030 754 tablet_bootstrap.cc:492] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
I20251215 20:51:12.433565 754 ts_tablet_manager.cc:1403] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.144s user 0.017s sys 0.002s
I20251215 20:51:12.437062 754 raft_consensus.cc:359] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.437788 754 raft_consensus.cc:385] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.438067 754 raft_consensus.cc:740] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.438768 754 consensus_queue.cc:260] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.440959 753 tablet_bootstrap.cc:654] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.446772 753 tablet_bootstrap.cc:492] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
I20251215 20:51:12.447206 753 ts_tablet_manager.cc:1403] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.185s user 0.007s sys 0.008s
I20251215 20:51:12.450954 753 raft_consensus.cc:359] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.451614 753 raft_consensus.cc:385] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.452011 753 raft_consensus.cc:740] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.452942 755 tablet_bootstrap.cc:492] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:12.452801 753 consensus_queue.cc:260] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.453455 755 ts_tablet_manager.cc:1403] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.092s user 0.012s sys 0.013s
I20251215 20:51:12.456554 586 heartbeater.cc:499] Master 127.0.106.190:36099 was elected leader, sending a full tablet report...
I20251215 20:51:12.457010 755 raft_consensus.cc:359] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.457633 755 raft_consensus.cc:385] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.457935 755 raft_consensus.cc:740] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.457644 754 ts_tablet_manager.cc:1434] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.024s user 0.004s sys 0.009s
I20251215 20:51:12.459388 754 tablet_bootstrap.cc:492] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:12.465554 754 tablet_bootstrap.cc:654] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.469020 755 consensus_queue.cc:260] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.472935 661 heartbeater.cc:499] Master 127.0.106.190:36099 was elected leader, sending a full tablet report...
I20251215 20:51:12.473260 753 ts_tablet_manager.cc:1434] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.026s user 0.010s sys 0.016s
I20251215 20:51:12.474177 753 tablet_bootstrap.cc:492] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:12.480001 735 heartbeater.cc:499] Master 127.0.106.190:36099 was elected leader, sending a full tablet report...
I20251215 20:51:12.480634 755 ts_tablet_manager.cc:1434] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.027s user 0.008s sys 0.003s
I20251215 20:51:12.481493 755 tablet_bootstrap.cc:492] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:12.487605 753 tablet_bootstrap.cc:654] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.492244 754 tablet_bootstrap.cc:492] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
I20251215 20:51:12.493832 754 ts_tablet_manager.cc:1403] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.011s
I20251215 20:51:12.496457 754 raft_consensus.cc:359] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:12.497077 755 tablet_bootstrap.cc:654] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.497200 754 raft_consensus.cc:385] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.497592 754 raft_consensus.cc:740] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.498397 754 consensus_queue.cc:260] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:12.501174 754 ts_tablet_manager.cc:1434] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20251215 20:51:12.502051 587 tablet.cc:2378] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 20:51:12.504014 754 tablet_bootstrap.cc:492] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:12.513144 754 tablet_bootstrap.cc:654] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.527316 754 tablet_bootstrap.cc:492] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
I20251215 20:51:12.527832 754 ts_tablet_manager.cc:1403] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.024s user 0.018s sys 0.000s
I20251215 20:51:12.531219 753 tablet_bootstrap.cc:492] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
I20251215 20:51:12.531651 753 ts_tablet_manager.cc:1403] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.058s user 0.012s sys 0.014s
I20251215 20:51:12.531575 754 raft_consensus.cc:359] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.532840 754 raft_consensus.cc:385] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.533133 754 raft_consensus.cc:740] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.533737 754 consensus_queue.cc:260] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.534544 753 raft_consensus.cc:359] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.535714 753 raft_consensus.cc:385] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.536008 753 raft_consensus.cc:740] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.536667 753 consensus_queue.cc:260] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.537909 754 ts_tablet_manager.cc:1434] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20251215 20:51:12.538645 753 ts_tablet_manager.cc:1434] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20251215 20:51:12.538774 754 tablet_bootstrap.cc:492] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:12.539497 753 tablet_bootstrap.cc:492] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:12.545373 754 tablet_bootstrap.cc:654] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.546427 755 tablet_bootstrap.cc:492] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:12.546840 755 ts_tablet_manager.cc:1403] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.066s user 0.009s sys 0.016s
I20251215 20:51:12.549489 755 raft_consensus.cc:359] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.550241 755 raft_consensus.cc:385] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.550556 755 raft_consensus.cc:740] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.551209 755 consensus_queue.cc:260] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.555073 755 ts_tablet_manager.cc:1434] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20251215 20:51:12.555910 755 tablet_bootstrap.cc:492] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:12.557185 754 tablet_bootstrap.cc:492] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
I20251215 20:51:12.557611 754 ts_tablet_manager.cc:1403] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20251215 20:51:12.560079 754 raft_consensus.cc:359] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.560763 754 raft_consensus.cc:385] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.561043 754 raft_consensus.cc:740] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.561718 755 tablet_bootstrap.cc:654] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.561663 754 consensus_queue.cc:260] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.564237 754 ts_tablet_manager.cc:1434] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:51:12.565161 754 tablet_bootstrap.cc:492] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:12.566691 753 tablet_bootstrap.cc:654] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.571167 754 tablet_bootstrap.cc:654] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.574664 755 tablet_bootstrap.cc:492] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:12.576233 755 ts_tablet_manager.cc:1403] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.001s
I20251215 20:51:12.580154 753 tablet_bootstrap.cc:492] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
I20251215 20:51:12.580674 753 ts_tablet_manager.cc:1403] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.006s
I20251215 20:51:12.581204 754 tablet_bootstrap.cc:492] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
I20251215 20:51:12.581619 754 ts_tablet_manager.cc:1403] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.008s
I20251215 20:51:12.582062 755 raft_consensus.cc:359] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.582758 755 raft_consensus.cc:385] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.583037 755 raft_consensus.cc:740] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.583717 755 consensus_queue.cc:260] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.584545 754 raft_consensus.cc:359] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.585242 754 raft_consensus.cc:385] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.585511 754 raft_consensus.cc:740] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.586410 755 ts_tablet_manager.cc:1434] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.010s user 0.003s sys 0.003s
I20251215 20:51:12.586126 754 consensus_queue.cc:260] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.587217 755 tablet_bootstrap.cc:492] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:12.588863 760 raft_consensus.cc:493] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.589315 760 raft_consensus.cc:515] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.591344 754 ts_tablet_manager.cc:1434] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.009s user 0.001s sys 0.005s
I20251215 20:51:12.589277 753 raft_consensus.cc:359] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:12.594348 753 raft_consensus.cc:385] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.594650 753 raft_consensus.cc:740] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.595377 753 consensus_queue.cc:260] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:12.592538 754 tablet_bootstrap.cc:492] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:12.593603 755 tablet_bootstrap.cc:654] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.593984 760 leader_election.cc:290] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.612871 753 ts_tablet_manager.cc:1434] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.032s user 0.009s sys 0.006s
I20251215 20:51:12.615378 754 tablet_bootstrap.cc:654] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.620164 753 tablet_bootstrap.cc:492] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:12.624099 755 tablet_bootstrap.cc:492] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:12.624629 755 ts_tablet_manager.cc:1403] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.038s user 0.018s sys 0.007s
I20251215 20:51:12.626353 753 tablet_bootstrap.cc:654] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.627390 755 raft_consensus.cc:359] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.628154 755 raft_consensus.cc:385] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.628507 755 raft_consensus.cc:740] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.629315 755 consensus_queue.cc:260] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.637534 755 ts_tablet_manager.cc:1434] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20251215 20:51:12.643805 755 tablet_bootstrap.cc:492] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:12.647836 561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:12.648602 561 raft_consensus.cc:2468] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 0.
I20251215 20:51:12.650043 599 leader_election.cc:304] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:12.650820 760 raft_consensus.cc:2804] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:12.651158 760 raft_consensus.cc:493] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:12.651928 760 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.652210 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:12.652613 755 tablet_bootstrap.cc:654] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
W20251215 20:51:12.654654 599 leader_election.cc:343] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.658496 753 tablet_bootstrap.cc:492] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
I20251215 20:51:12.658941 753 ts_tablet_manager.cc:1403] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.039s user 0.020s sys 0.006s
I20251215 20:51:12.659785 760 raft_consensus.cc:515] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.671463 753 raft_consensus.cc:359] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.672711 561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:12.673260 561 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.673703 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
W20251215 20:51:12.674806 599 leader_election.cc:343] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.676079 754 tablet_bootstrap.cc:492] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
I20251215 20:51:12.676538 754 ts_tablet_manager.cc:1403] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.084s user 0.009s sys 0.022s
I20251215 20:51:12.677309 755 tablet_bootstrap.cc:492] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:12.677729 755 ts_tablet_manager.cc:1403] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.034s user 0.012s sys 0.000s
I20251215 20:51:12.678953 760 leader_election.cc:290] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.680159 754 raft_consensus.cc:359] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.680685 753 raft_consensus.cc:385] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.680465 755 raft_consensus.cc:359] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.680892 754 raft_consensus.cc:385] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.681262 755 raft_consensus.cc:385] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.681322 754 raft_consensus.cc:740] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.680454 561 raft_consensus.cc:2468] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 1.
I20251215 20:51:12.681704 755 raft_consensus.cc:740] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.681129 753 raft_consensus.cc:740] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.682251 754 consensus_queue.cc:260] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.682569 599 leader_election.cc:304] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters: a5c532b76e95438e954f519e3d864b63
I20251215 20:51:12.683212 753 consensus_queue.cc:260] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.683724 755 consensus_queue.cc:260] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.685292 762 raft_consensus.cc:493] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.683703 760 raft_consensus.cc:2804] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:12.685696 762 raft_consensus.cc:515] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.688181 760 raft_consensus.cc:697] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:12.689236 762 leader_election.cc:290] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:12.689843 762 raft_consensus.cc:493] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.688997 760 consensus_queue.cc:237] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.698915 758 raft_consensus.cc:493] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.690233 762 raft_consensus.cc:515] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.700726 758 raft_consensus.cc:515] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:12.701284 772 raft_consensus.cc:493] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.703735 753 ts_tablet_manager.cc:1434] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.045s user 0.006s sys 0.004s
I20251215 20:51:12.704663 753 tablet_bootstrap.cc:492] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:12.706815 758 leader_election.cc:290] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:12.706539 755 ts_tablet_manager.cc:1434] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.029s user 0.008s sys 0.001s
I20251215 20:51:12.702690 772 raft_consensus.cc:515] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.726472 754 ts_tablet_manager.cc:1434] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.050s user 0.002s sys 0.006s
I20251215 20:51:12.726056 755 tablet_bootstrap.cc:492] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:12.737562 754 tablet_bootstrap.cc:492] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:12.738313 772 leader_election.cc:290] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.741899 561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:12.742527 561 raft_consensus.cc:2468] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 0.
I20251215 20:51:12.743654 599 leader_election.cc:304] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:12.746577 772 raft_consensus.cc:2804] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:12.746963 772 raft_consensus.cc:493] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:12.747300 772 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.758968 758 raft_consensus.cc:493] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.759461 758 raft_consensus.cc:515] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.773010 754 tablet_bootstrap.cc:654] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.786067 778 raft_consensus.cc:493] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.790779 758 leader_election.cc:290] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.788843 762 leader_election.cc:290] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:12.793133 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:12.786612 778 raft_consensus.cc:515] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
W20251215 20:51:12.795500 599 leader_election.cc:343] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.797559 772 raft_consensus.cc:515] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.806187 778 leader_election.cc:290] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:12.817610 561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:12.818169 561 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.828985 561 raft_consensus.cc:2468] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 1.
I20251215 20:51:12.830559 599 leader_election.cc:304] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:12.833325 772 leader_election.cc:290] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.835305 760 raft_consensus.cc:2804] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:12.835093 755 tablet_bootstrap.cc:654] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.841719 760 raft_consensus.cc:697] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:12.841850 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
W20251215 20:51:12.845820 524 leader_election.cc:343] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.845849 709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:12.847433 709 raft_consensus.cc:2468] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 0.
I20251215 20:51:12.842911 760 consensus_queue.cc:237] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.849090 524 leader_election.cc:304] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:12.850819 758 raft_consensus.cc:2804] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:12.852106 758 raft_consensus.cc:493] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:12.852470 758 raft_consensus.cc:3060] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.867197 778 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.867645 455 catalog_manager.cc:5654] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:12.874557 778 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.886626 636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.889928 778 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:12.888600 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.890406 636 raft_consensus.cc:2468] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 0.
I20251215 20:51:12.892015 753 tablet_bootstrap.cc:654] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:12.892282 754 tablet_bootstrap.cc:492] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
W20251215 20:51:12.893770 525 leader_election.cc:343] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.895043 758 raft_consensus.cc:515] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.896063 525 leader_election.cc:304] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters: a5c532b76e95438e954f519e3d864b63
I20251215 20:51:12.895421 754 ts_tablet_manager.cc:1403] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.158s user 0.013s sys 0.025s
W20251215 20:51:12.893265 599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:36641, user_credentials={real_user=slave}} blocked reactor thread for 63292us
I20251215 20:51:12.899487 778 raft_consensus.cc:493] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.899895 778 raft_consensus.cc:515] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.900234 709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:12.902312 758 leader_election.cc:290] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.902767 758 raft_consensus.cc:493] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.903245 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.903299 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:12.903546 636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.903136 758 raft_consensus.cc:515] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.903990 710 raft_consensus.cc:3060] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.905462 758 leader_election.cc:290] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.905247 754 raft_consensus.cc:359] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.906203 754 raft_consensus.cc:385] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:12.906213 758 raft_consensus.cc:493] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.906591 754 raft_consensus.cc:740] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:12.907040 758 raft_consensus.cc:515] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.907625 754 consensus_queue.cc:260] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.906663 772 raft_consensus.cc:493] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.909305 772 raft_consensus.cc:515] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.909705 758 leader_election.cc:290] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.910182 758 raft_consensus.cc:2804] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:12.910529 758 raft_consensus.cc:493] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:12.911135 758 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.912017 772 leader_election.cc:290] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.910202 754 ts_tablet_manager.cc:1434] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.012s user 0.003s sys 0.002s
I20251215 20:51:12.915005 709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
W20251215 20:51:12.908711 599 leader_election.cc:343] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.932336 758 raft_consensus.cc:515] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:12.934306 758 leader_election.cc:290] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Requested vote from peers a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:12.935201 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
W20251215 20:51:12.936545 524 leader_election.cc:343] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.928189 708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:12.927294 709 raft_consensus.cc:2468] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 0.
I20251215 20:51:12.944023 754 tablet_bootstrap.cc:492] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:12.937644 758 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:12.947116 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:12.948177 707 raft_consensus.cc:2468] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 0.
W20251215 20:51:12.950309 524 leader_election.cc:343] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.950937 524 leader_election.cc:304] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:12.949543 758 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.949348 710 raft_consensus.cc:2468] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 1.
I20251215 20:51:12.953562 778 leader_election.cc:290] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:12.954290 599 leader_election.cc:304] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:12.954435 789 raft_consensus.cc:2804] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:12.954530 636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.956964 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.958247 789 raft_consensus.cc:493] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:12.959474 789 raft_consensus.cc:3060] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.956977 524 leader_election.cc:304] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:12.959367 787 raft_consensus.cc:2804] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:12.962242 787 raft_consensus.cc:493] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:51:12.958278 525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:42463, user_credentials={real_user=slave}} blocked reactor thread for 62603us
W20251215 20:51:12.963637 674 leader_election.cc:343] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.963719 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.962944 787 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:51:12.965111 674 leader_election.cc:343] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.965128 636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:12.967279 561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
W20251215 20:51:12.967397 674 leader_election.cc:343] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.970566 634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.968401 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:12.973270 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:12.974277 758 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:12.974912 561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:12.975492 561 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 0.
I20251215 20:51:12.976017 754 tablet_bootstrap.cc:654] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
W20251215 20:51:12.976672 674 leader_election.cc:343] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.977960 636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.976627 561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:12.977725 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5"
W20251215 20:51:12.982609 673 leader_election.cc:343] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.983866 633 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:12.980634 558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:12.983952 673 leader_election.cc:304] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5c532b76e95438e954f519e3d864b63; no voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:12.982151 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
W20251215 20:51:12.985862 599 leader_election.cc:343] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.990073 673 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters: 6b027efaf85440c49a962daf569191f5
I20251215 20:51:12.991236 753 tablet_bootstrap.cc:492] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
W20251215 20:51:12.992726 673 leader_election.cc:343] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.992852 753 ts_tablet_manager.cc:1403] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.288s user 0.020s sys 0.021s
I20251215 20:51:12.985422 755 tablet_bootstrap.cc:492] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:12.988950 634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:12.993973 755 ts_tablet_manager.cc:1403] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.268s user 0.030s sys 0.017s
I20251215 20:51:12.993492 778 raft_consensus.cc:2749] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:51:12.985121 525 leader_election.cc:343] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.997891 633 raft_consensus.cc:2468] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 1.
I20251215 20:51:12.985010 791 raft_consensus.cc:2804] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:13.006122 791 raft_consensus.cc:697] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
W20251215 20:51:13.006378 525 leader_election.cc:343] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:13.006830 525 leader_election.cc:304] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d73987d0b39f4d0593c0d7849e139e28; no voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63
I20251215 20:51:13.007537 758 raft_consensus.cc:2749] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:51:13.008473 525 leader_election.cc:343] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:12.997560 753 raft_consensus.cc:359] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.988108 789 raft_consensus.cc:515] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:12.994506 710 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 0.
I20251215 20:51:13.010522 762 raft_consensus.cc:2804] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:13.010788 791 consensus_queue.cc:237] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.009610 753 raft_consensus.cc:385] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.012446 753 raft_consensus.cc:740] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.013206 762 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:13.013119 753 consensus_queue.cc:260] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.013650 762 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.014659 560 raft_consensus.cc:2393] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5c532b76e95438e954f519e3d864b63 in current term 1: Already voted for candidate d73987d0b39f4d0593c0d7849e139e28 in this term.
I20251215 20:51:13.019807 755 raft_consensus.cc:359] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.021358 755 raft_consensus.cc:385] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.021647 755 raft_consensus.cc:740] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.019006 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:13.019464 789 leader_election.cc:290] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:13.017688 787 raft_consensus.cc:515] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
W20251215 20:51:13.027678 525 leader_election.cc:343] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:13.029146 707 raft_consensus.cc:3060] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.022289 755 consensus_queue.cc:260] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.029172 673 leader_election.cc:304] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5c532b76e95438e954f519e3d864b63; no voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.030213 525 leader_election.cc:304] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters: a5c532b76e95438e954f519e3d864b63
I20251215 20:51:13.039712 635 raft_consensus.cc:2393] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5c532b76e95438e954f519e3d864b63 in current term 1: Already voted for candidate 6b027efaf85440c49a962daf569191f5 in this term.
I20251215 20:51:13.043646 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:13.043715 762 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.044395 633 raft_consensus.cc:3060] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.048198 754 tablet_bootstrap.cc:492] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
I20251215 20:51:13.048717 754 ts_tablet_manager.cc:1403] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.117s user 0.013s sys 0.007s
I20251215 20:51:13.042236 524 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters: 6b027efaf85440c49a962daf569191f5
I20251215 20:51:13.049589 758 raft_consensus.cc:2804] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:13.049952 758 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:13.052779 758 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.054477 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:13.038182 789 raft_consensus.cc:2804] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election won for term 1
W20251215 20:51:13.084772 599 leader_election.cc:343] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:13.078050 789 raft_consensus.cc:697] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:13.089277 753 ts_tablet_manager.cc:1434] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.096s user 0.011s sys 0.006s
I20251215 20:51:13.093170 762 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:13.093253 674 leader_election.cc:304] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5c532b76e95438e954f519e3d864b63; no voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.094287 755 ts_tablet_manager.cc:1434] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.094s user 0.009s sys 0.004s
I20251215 20:51:13.094771 762 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.095242 755 tablet_bootstrap.cc:492] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:13.098281 758 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.101042 758 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:13.095178 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:13.102140 634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5"
W20251215 20:51:13.092933 673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:36641, user_credentials={real_user=slave}} blocked reactor thread for 64670.4us
I20251215 20:51:13.100643 789 consensus_queue.cc:237] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
W20251215 20:51:13.100122 599 consensus_peers.cc:597] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 -> Peer a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957): Couldn't send request to peer a5c532b76e95438e954f519e3d864b63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:51:13.113373 707 raft_consensus.cc:2468] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 1.
W20251215 20:51:13.113366 525 leader_election.cc:343] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:13.102486 633 raft_consensus.cc:2468] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 1.
W20251215 20:51:13.115603 674 leader_election.cc:343] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:13.116783 525 leader_election.cc:304] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:13.115932 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:13.115200 778 raft_consensus.cc:2749] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.115164 753 tablet_bootstrap.cc:492] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:13.120806 791 raft_consensus.cc:2804] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:13.121889 560 raft_consensus.cc:2393] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a5c532b76e95438e954f519e3d864b63 in current term 1: Already voted for candidate d73987d0b39f4d0593c0d7849e139e28 in this term.
I20251215 20:51:13.123082 791 raft_consensus.cc:697] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:13.122206 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:13.124073 754 raft_consensus.cc:359] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.125097 754 raft_consensus.cc:385] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.125365 754 raft_consensus.cc:740] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.125949 707 raft_consensus.cc:2393] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d73987d0b39f4d0593c0d7849e139e28 in current term 1: Already voted for candidate a5c532b76e95438e954f519e3d864b63 in this term.
I20251215 20:51:13.125905 754 consensus_queue.cc:260] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.129135 754 ts_tablet_manager.cc:1434] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.079s user 0.004s sys 0.003s
I20251215 20:51:13.129792 754 tablet_bootstrap.cc:492] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28: Bootstrap starting.
I20251215 20:51:13.125644 791 consensus_queue.cc:237] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.126518 673 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5c532b76e95438e954f519e3d864b63; no voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.133489 799 raft_consensus.cc:2749] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.135169 524 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d73987d0b39f4d0593c0d7849e139e28; no voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63
I20251215 20:51:13.136163 758 raft_consensus.cc:2749] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.138967 762 raft_consensus.cc:2749] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.139358 754 tablet_bootstrap.cc:654] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:13.143177 755 tablet_bootstrap.cc:654] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:13.155767 755 tablet_bootstrap.cc:492] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:13.156224 755 ts_tablet_manager.cc:1403] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.061s user 0.005s sys 0.009s
I20251215 20:51:13.156342 787 leader_election.cc:290] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:13.157016 673 leader_election.cc:304] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5c532b76e95438e954f519e3d864b63; no voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.157912 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:13.160168 762 raft_consensus.cc:2749] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.167623 455 catalog_manager.cc:5654] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 0 to 1, leader changed from <none> to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:13.169067 707 raft_consensus.cc:2468] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 1.
I20251215 20:51:13.171013 458 catalog_manager.cc:5654] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:13.172237 599 leader_election.cc:304] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters: d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.202936 787 raft_consensus.cc:2804] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:13.203891 754 tablet_bootstrap.cc:492] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28: No bootstrap required, opened a new log
I20251215 20:51:13.203400 787 raft_consensus.cc:697] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:13.204424 754 ts_tablet_manager.cc:1403] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28: Time spent bootstrapping tablet: real 0.075s user 0.006s sys 0.006s
I20251215 20:51:13.203786 755 raft_consensus.cc:359] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:13.205200 755 raft_consensus.cc:385] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.204766 753 tablet_bootstrap.cc:654] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:13.205508 755 raft_consensus.cc:740] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.204766 787 consensus_queue.cc:237] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.206974 754 raft_consensus.cc:359] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.207595 754 raft_consensus.cc:385] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.207876 754 raft_consensus.cc:740] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.208359 760 consensus_queue.cc:1048] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:13.208525 754 consensus_queue.cc:260] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.210672 754 ts_tablet_manager.cc:1434] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:51:13.214078 755 consensus_queue.cc:260] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:13.215516 455 catalog_manager.cc:5654] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 0 to 1, leader changed from <none> to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:13.217887 755 ts_tablet_manager.cc:1434] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.061s user 0.003s sys 0.003s
I20251215 20:51:13.217613 455 catalog_manager.cc:5654] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 0 to 1, leader changed from <none> to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:13.218779 755 tablet_bootstrap.cc:492] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:13.231171 753 tablet_bootstrap.cc:492] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
I20251215 20:51:13.231660 753 ts_tablet_manager.cc:1403] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.121s user 0.010s sys 0.015s
I20251215 20:51:13.234678 753 raft_consensus.cc:359] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.235641 753 raft_consensus.cc:385] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.235921 753 raft_consensus.cc:740] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.238619 755 tablet_bootstrap.cc:654] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:13.241904 753 consensus_queue.cc:260] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.244809 753 ts_tablet_manager.cc:1434] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.013s user 0.006s sys 0.002s
I20251215 20:51:13.245733 753 tablet_bootstrap.cc:492] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:13.247351 457 catalog_manager.cc:5654] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:13.253247 755 tablet_bootstrap.cc:492] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:13.253656 755 ts_tablet_manager.cc:1403] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.003s
I20251215 20:51:13.260422 762 raft_consensus.cc:493] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:13.260869 762 raft_consensus.cc:515] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:13.262709 762 leader_election.cc:290] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:13.263514 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:13.264042 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:13.264818 633 raft_consensus.cc:2393] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5c532b76e95438e954f519e3d864b63 in current term 1: Already voted for candidate d73987d0b39f4d0593c0d7849e139e28 in this term.
I20251215 20:51:13.265851 674 leader_election.cc:304] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5c532b76e95438e954f519e3d864b63; no voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.266829 762 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.270900 789 raft_consensus.cc:493] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:13.271320 789 raft_consensus.cc:515] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
W20251215 20:51:13.273175 506 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:51:13.273118 789 leader_election.cc:290] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:13.274556 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:13.274556 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:13.275210 707 raft_consensus.cc:2468] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 0.
I20251215 20:51:13.275315 633 raft_consensus.cc:2468] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 0.
I20251215 20:51:13.275769 755 raft_consensus.cc:359] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.276105 524 leader_election.cc:304] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:13.276398 755 raft_consensus.cc:385] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.276676 755 raft_consensus.cc:740] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.277155 789 raft_consensus.cc:2804] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:13.277424 789 raft_consensus.cc:493] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:13.277659 789 raft_consensus.cc:3060] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.279680 753 tablet_bootstrap.cc:654] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:13.277580 762 raft_consensus.cc:2749] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.282732 789 raft_consensus.cc:515] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.282755 755 consensus_queue.cc:260] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.284936 755 ts_tablet_manager.cc:1434] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.031s user 0.007s sys 0.000s
I20251215 20:51:13.285774 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:13.286281 633 raft_consensus.cc:3060] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.288527 755 tablet_bootstrap.cc:492] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63: Bootstrap starting.
I20251215 20:51:13.293265 633 raft_consensus.cc:2468] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 1.
I20251215 20:51:13.294190 525 leader_election.cc:304] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:13.294590 755 tablet_bootstrap.cc:654] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:13.294946 791 raft_consensus.cc:2804] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:13.295384 791 raft_consensus.cc:697] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:13.296121 791 consensus_queue.cc:237] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.299193 753 tablet_bootstrap.cc:492] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
I20251215 20:51:13.299660 753 ts_tablet_manager.cc:1403] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.004s
I20251215 20:51:13.302798 753 raft_consensus.cc:359] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.303274 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:13.303804 707 raft_consensus.cc:3060] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.305115 753 raft_consensus.cc:385] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.305433 753 raft_consensus.cc:740] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.306094 753 consensus_queue.cc:260] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.309089 753 ts_tablet_manager.cc:1434] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.009s user 0.008s sys 0.001s
I20251215 20:51:13.309970 753 tablet_bootstrap.cc:492] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:13.310945 457 catalog_manager.cc:5654] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 0 to 1, leader changed from <none> to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:13.316040 753 tablet_bootstrap.cc:654] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:13.318015 755 tablet_bootstrap.cc:492] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63: No bootstrap required, opened a new log
I20251215 20:51:13.318423 755 ts_tablet_manager.cc:1403] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.003s
I20251215 20:51:13.321137 707 raft_consensus.cc:2468] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 1.
I20251215 20:51:13.321200 755 raft_consensus.cc:359] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.321871 755 raft_consensus.cc:385] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.321841 789 leader_election.cc:290] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:13.322263 755 raft_consensus.cc:740] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.322919 755 consensus_queue.cc:260] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.324856 755 ts_tablet_manager.cc:1434] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20251215 20:51:13.333668 753 tablet_bootstrap.cc:492] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
I20251215 20:51:13.334086 753 ts_tablet_manager.cc:1403] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.004s
I20251215 20:51:13.335724 753 raft_consensus.cc:359] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.336194 753 raft_consensus.cc:385] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.336433 753 raft_consensus.cc:740] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.336939 753 consensus_queue.cc:260] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.338555 753 ts_tablet_manager.cc:1434] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251215 20:51:13.339529 753 tablet_bootstrap.cc:492] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5: Bootstrap starting.
I20251215 20:51:13.340140 707 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.349642 753 tablet_bootstrap.cc:654] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:13.352689 787 consensus_queue.cc:1048] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:13.354113 753 tablet_bootstrap.cc:492] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5: No bootstrap required, opened a new log
I20251215 20:51:13.354502 753 ts_tablet_manager.cc:1403] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.002s
I20251215 20:51:13.357066 753 raft_consensus.cc:359] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.357672 753 raft_consensus.cc:385] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:13.357923 753 raft_consensus.cc:740] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Initialized, Role: FOLLOWER
I20251215 20:51:13.359158 753 consensus_queue.cc:260] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.361054 753 ts_tablet_manager.cc:1434] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20251215 20:51:13.369448 772 consensus_queue.cc:1048] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:13.433091 762 raft_consensus.cc:493] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:13.433583 762 raft_consensus.cc:515] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.435426 762 leader_election.cc:290] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:13.436838 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:13.436163 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:13.438762 673 leader_election.cc:304] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5c532b76e95438e954f519e3d864b63; no voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.439723 762 raft_consensus.cc:2749] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.440165 633 raft_consensus.cc:3060] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.440663 789 consensus_queue.cc:1048] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:13.448621 792 consensus_queue.cc:1048] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:51:13.449219 772 raft_consensus.cc:493] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:13.449645 772 raft_consensus.cc:515] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.451421 772 leader_election.cc:290] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:13.452986 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:13.455734 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:13.458220 599 leader_election.cc:304] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b027efaf85440c49a962daf569191f5; no voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.460425 772 raft_consensus.cc:2749] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:51:13.497720 772 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:13.498230 772 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.499770 772 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:13.500655 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:13.500974 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:13.501411 560 raft_consensus.cc:2393] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b027efaf85440c49a962daf569191f5 in current term 1: Already voted for candidate d73987d0b39f4d0593c0d7849e139e28 in this term.
I20251215 20:51:13.501645 707 raft_consensus.cc:2393] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b027efaf85440c49a962daf569191f5 in current term 1: Already voted for candidate a5c532b76e95438e954f519e3d864b63 in this term.
I20251215 20:51:13.502542 599 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b027efaf85440c49a962daf569191f5; no voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:13.503093 772 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.507685 772 raft_consensus.cc:2749] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.523875 792 consensus_queue.cc:1048] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:51:13.534749 791 raft_consensus.cc:493] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:13.534633 789 consensus_queue.cc:1048] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:13.535202 791 raft_consensus.cc:515] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.538825 707 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.541610 791 leader_election.cc:290] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:13.544432 709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:13.544989 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:13.545264 709 raft_consensus.cc:2393] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d73987d0b39f4d0593c0d7849e139e28 in current term 1: Already voted for candidate 6b027efaf85440c49a962daf569191f5 in this term.
I20251215 20:51:13.546726 525 leader_election.cc:304] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d73987d0b39f4d0593c0d7849e139e28; no voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63
I20251215 20:51:13.547830 791 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.555358 791 raft_consensus.cc:2749] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:13.613682 772 consensus_queue.cc:1048] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:13.623970 772 consensus_queue.cc:1048] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:51:13.647046 762 raft_consensus.cc:493] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:13.647475 762 raft_consensus.cc:515] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.648929 762 leader_election.cc:290] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:13.649792 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:13.649951 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28" is_pre_election: true
I20251215 20:51:13.650255 633 raft_consensus.cc:2468] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 0.
I20251215 20:51:13.650573 560 raft_consensus.cc:2468] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 0.
I20251215 20:51:13.651032 674 leader_election.cc:304] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:13.651708 762 raft_consensus.cc:2804] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:13.652078 762 raft_consensus.cc:493] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:13.652410 762 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.656545 762 raft_consensus.cc:515] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.657879 762 leader_election.cc:290] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:13.658555 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:13.658959 560 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.658833 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:13.659401 633 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:13.662999 560 raft_consensus.cc:2468] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 1.
I20251215 20:51:13.663780 673 leader_election.cc:304] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:13.664357 762 raft_consensus.cc:2804] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:13.664707 762 raft_consensus.cc:697] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 1 LEADER]: Becoming Leader. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:13.665448 762 consensus_queue.cc:237] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:13.665900 633 raft_consensus.cc:2468] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 1.
I20251215 20:51:13.672889 455 catalog_manager.cc:5654] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5c532b76e95438e954f519e3d864b63 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "a5c532b76e95438e954f519e3d864b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:13.739549 791 consensus_queue.cc:1048] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:13.743957 791 consensus_queue.cc:1048] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:51:13.807417 792 consensus_queue.cc:1048] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:13.817739 758 consensus_queue.cc:1048] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:14.230782 762 consensus_queue.cc:1048] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:14.241722 762 consensus_queue.cc:1048] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:51:14.276782 506 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:51:14.873320 789 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:14.873709 789 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:14.875118 789 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:14.875769 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5" is_pre_election: true
I20251215 20:51:14.876009 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63" is_pre_election: true
I20251215 20:51:14.876389 633 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 1.
I20251215 20:51:14.876564 707 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 1.
I20251215 20:51:14.877686 525 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:14.878448 758 raft_consensus.cc:2804] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:51:14.878777 758 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:14.879096 758 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:14.884171 758 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:14.885452 758 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:14.886034 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:14.886253 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:14.886425 633 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:14.886709 710 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:14.890808 633 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 2.
I20251215 20:51:14.891129 710 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 2.
I20251215 20:51:14.891700 525 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:14.892340 758 raft_consensus.cc:2804] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:14.892736 758 raft_consensus.cc:697] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:14.893391 758 consensus_queue.cc:237] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:14.899056 455 catalog_manager.cc:5654] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 0 to 2, leader changed from <none> to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:15.367058 633 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 20:51:15.368139 789 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:15.377163 710 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 20:51:15.378227 789 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:15.402454 633 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "07d9fca6769e426c96573179099e83d7"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:60062
I20251215 20:51:15.402951 633 raft_consensus.cc:606] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Received request to transfer leadership to TS d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:15.407491 633 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:60062
I20251215 20:51:15.407905 633 raft_consensus.cc:606] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Received request to transfer leadership to TS d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:15.411847 633 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:60062
I20251215 20:51:15.412231 633 raft_consensus.cc:606] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Received request to transfer leadership to TS d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:15.422848 559 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:51054
I20251215 20:51:15.423358 559 raft_consensus.cc:606] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:15.427186 559 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:51054
I20251215 20:51:15.427640 559 raft_consensus.cc:606] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:15.438232 710 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284"
dest_uuid: "a5c532b76e95438e954f519e3d864b63"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:39974
I20251215 20:51:15.438683 710 raft_consensus.cc:606] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 1 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:15.442660 559 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:51054
I20251215 20:51:15.443073 559 raft_consensus.cc:606] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:15.446702 559 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
mode: GRACEFUL
new_leader_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:51054
I20251215 20:51:15.447088 559 raft_consensus.cc:606] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Received request to transfer leadership to TS a5c532b76e95438e954f519e3d864b63
I20251215 20:51:15.659257 848 raft_consensus.cc:993] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:15.659674 762 raft_consensus.cc:1081] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 1 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:15.661023 633 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60032
I20251215 20:51:15.661458 633 raft_consensus.cc:493] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:15.661702 633 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.665922 633 raft_consensus.cc:515] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.667299 633 leader_election.cc:290] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:15.668315 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:15.668491 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:15.668824 559 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.669031 710 raft_consensus.cc:3055] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:15.669366 710 raft_consensus.cc:740] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:15.670123 710 consensus_queue.cc:260] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.671113 758 raft_consensus.cc:993] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:15.671404 710 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.671527 758 raft_consensus.cc:1081] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:15.672982 633 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60048
I20251215 20:51:15.673528 633 raft_consensus.cc:493] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:15.673887 633 raft_consensus.cc:3060] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.674502 559 raft_consensus.cc:2468] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 2.
I20251215 20:51:15.675559 599 leader_election.cc:304] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:15.676090 710 raft_consensus.cc:2468] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 2.
I20251215 20:51:15.676318 787 raft_consensus.cc:2804] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:15.677495 787 raft_consensus.cc:697] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:15.678193 787 consensus_queue.cc:237] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.679042 633 raft_consensus.cc:515] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.680461 633 leader_election.cc:290] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:15.681164 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:15.681699 559 raft_consensus.cc:3055] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:15.681646 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33a15ec522a14ad3bc4da7093b3e959e" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:15.682121 559 raft_consensus.cc:740] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:15.682370 710 raft_consensus.cc:3060] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.682869 559 consensus_queue.cc:260] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.684015 559 raft_consensus.cc:3060] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.685505 758 raft_consensus.cc:993] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:15.686035 758 raft_consensus.cc:1081] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:15.687696 635 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60048
I20251215 20:51:15.688236 635 raft_consensus.cc:493] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:15.688624 635 raft_consensus.cc:3060] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.689122 710 raft_consensus.cc:2468] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 2.
I20251215 20:51:15.690264 599 leader_election.cc:304] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:15.690619 559 raft_consensus.cc:2468] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 2.
I20251215 20:51:15.691854 849 raft_consensus.cc:2804] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:15.693224 849 raft_consensus.cc:697] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:15.694141 849 consensus_queue.cc:237] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.695184 635 raft_consensus.cc:515] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.695641 457 catalog_manager.cc:5654] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 1 to 2, leader changed from a5c532b76e95438e954f519e3d864b63 (127.0.106.131) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:15.697250 635 leader_election.cc:290] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:15.698175 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:15.698987 559 raft_consensus.cc:3055] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:15.698923 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "128c79ee45ee4f648ef464e5868728cb" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:15.699594 710 raft_consensus.cc:3060] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.703800 710 raft_consensus.cc:2468] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 2.
I20251215 20:51:15.704185 559 raft_consensus.cc:740] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:15.704802 599 leader_election.cc:304] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:15.705013 559 consensus_queue.cc:260] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.705590 787 raft_consensus.cc:2804] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:15.706054 787 raft_consensus.cc:697] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:15.706887 787 consensus_queue.cc:237] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.707741 559 raft_consensus.cc:3060] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.713316 559 raft_consensus.cc:2468] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 2.
I20251215 20:51:15.716996 457 catalog_manager.cc:5654] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 1 to 2, leader changed from d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:15.718014 457 catalog_manager.cc:5654] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 1 to 2, leader changed from d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:15.785771 758 raft_consensus.cc:993] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28: : Instructing follower a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:15.786130 789 raft_consensus.cc:1081] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Signalling peer a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:15.787302 710 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b"
dest_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:39972
I20251215 20:51:15.787739 710 raft_consensus.cc:493] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:15.788002 710 raft_consensus.cc:3060] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.792325 849 raft_consensus.cc:993] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5: : Instructing follower d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:15.792680 787 raft_consensus.cc:1081] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Signalling peer d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:15.792518 710 raft_consensus.cc:515] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.793906 559 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "07d9fca6769e426c96573179099e83d7"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:51036
I20251215 20:51:15.794046 710 leader_election.cc:290] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 2 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:15.794402 559 raft_consensus.cc:493] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:15.794772 559 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.794771 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:15.795009 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1445c97060d34de8b8037a3f1d38172b" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:15.795379 560 raft_consensus.cc:3055] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:15.795531 633 raft_consensus.cc:3060] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.795733 560 raft_consensus.cc:740] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:15.796512 560 consensus_queue.cc:260] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.797652 560 raft_consensus.cc:3060] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.799774 633 raft_consensus.cc:2468] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 2.
I20251215 20:51:15.800573 674 leader_election.cc:304] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:15.801153 762 raft_consensus.cc:2804] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:15.801054 559 raft_consensus.cc:515] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.801551 762 raft_consensus.cc:697] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 2 LEADER]: Becoming Leader. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:15.802784 762 consensus_queue.cc:237] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.803550 560 raft_consensus.cc:2468] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 2.
I20251215 20:51:15.804066 559 leader_election.cc:290] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:15.804179 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:15.804870 633 raft_consensus.cc:3055] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:15.805233 633 raft_consensus.cc:740] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:15.805949 633 consensus_queue.cc:260] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
W20251215 20:51:15.806917 787 consensus_queue.cc:1175] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a5c532b76e95438e954f519e3d864b63" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20251215 20:51:15.807072 633 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.807070 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:15.807695 710 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.813181 633 raft_consensus.cc:2468] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 2.
I20251215 20:51:15.813624 710 raft_consensus.cc:2468] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 2.
I20251215 20:51:15.814545 525 leader_election.cc:304] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:15.815243 789 raft_consensus.cc:2804] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:15.815691 789 raft_consensus.cc:697] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:15.816447 789 consensus_queue.cc:237] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.817494 457 catalog_manager.cc:5654] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 reported cstate change: term changed from 1 to 2, leader changed from d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129) to a5c532b76e95438e954f519e3d864b63 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "a5c532b76e95438e954f519e3d864b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:15.823688 455 catalog_manager.cc:5654] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 1 to 2, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:15.883114 851 raft_consensus.cc:993] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5: : Instructing follower d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:15.883584 849 raft_consensus.cc:1081] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Signalling peer d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:15.884794 559 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:51036
I20251215 20:51:15.885223 559 raft_consensus.cc:493] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:15.885485 559 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.889798 559 raft_consensus.cc:515] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.891366 559 leader_election.cc:290] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:15.892465 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:15.892644 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:15.893007 633 raft_consensus.cc:3055] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:15.893144 710 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.893304 633 raft_consensus.cc:740] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:15.893980 633 consensus_queue.cc:260] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.894793 633 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.898200 710 raft_consensus.cc:2468] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 2.
I20251215 20:51:15.898622 633 raft_consensus.cc:2468] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 2.
I20251215 20:51:15.899070 524 leader_election.cc:304] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:15.899758 758 raft_consensus.cc:2804] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:15.900094 758 raft_consensus.cc:697] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:15.900664 758 consensus_queue.cc:237] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.906890 455 catalog_manager.cc:5654] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 1 to 2, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:15.912108 787 raft_consensus.cc:993] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5: : Instructing follower d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:15.912530 849 raft_consensus.cc:1081] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Signalling peer d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:15.913156 789 raft_consensus.cc:993] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:15.913556 758 raft_consensus.cc:1081] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:15.913834 559 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:51036
I20251215 20:51:15.914333 559 raft_consensus.cc:493] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:15.914673 559 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.914839 633 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60048
I20251215 20:51:15.915266 633 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:15.915500 633 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:15.919217 633 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.919257 559 raft_consensus.cc:515] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.920450 633 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 3 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:15.921159 559 leader_election.cc:290] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:15.921406 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:15.921725 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:15.921943 635 raft_consensus.cc:3055] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:15.921867 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:15.922362 635 raft_consensus.cc:740] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:15.922536 560 raft_consensus.cc:3055] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:15.922240 707 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.922930 560 raft_consensus.cc:740] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:15.921868 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:15.923633 710 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:15.923686 560 consensus_queue.cc:260] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.923650 635 consensus_queue.cc:260] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.924947 560 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:15.925052 635 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:15.928784 707 raft_consensus.cc:2468] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 2.
I20251215 20:51:15.929670 524 leader_election.cc:304] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:15.930116 710 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 3.
I20251215 20:51:15.930382 758 raft_consensus.cc:2804] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:15.930954 758 raft_consensus.cc:697] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:15.931071 599 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:15.931839 849 raft_consensus.cc:2804] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:15.931816 758 consensus_queue.cc:237] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.932399 849 raft_consensus.cc:697] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:15.932694 560 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 3.
I20251215 20:51:15.933174 849 consensus_queue.cc:237] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:15.931066 635 raft_consensus.cc:2468] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 2.
I20251215 20:51:15.939792 455 catalog_manager.cc:5654] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 1 to 2, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:15.940148 457 catalog_manager.cc:5654] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 2 to 3, leader changed from d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:16.132119 560 raft_consensus.cc:1275] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.133136 849 consensus_queue.cc:1048] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.143424 710 raft_consensus.cc:1275] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.144785 851 consensus_queue.cc:1048] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.157384 560 raft_consensus.cc:1275] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.158459 851 consensus_queue.cc:1048] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:51:16.166860 710 raft_consensus.cc:1275] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.168067 849 consensus_queue.cc:1048] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.210537 560 raft_consensus.cc:1275] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.211635 762 consensus_queue.cc:1048] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.214747 635 raft_consensus.cc:1275] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.215926 762 consensus_queue.cc:1048] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.233776 710 raft_consensus.cc:1275] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.235440 758 consensus_queue.cc:1048] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.244820 635 raft_consensus.cc:1275] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.247185 789 consensus_queue.cc:1048] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.272048 710 raft_consensus.cc:1275] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.273036 849 consensus_queue.cc:1048] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.280718 560 raft_consensus.cc:1275] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.281913 868 consensus_queue.cc:1048] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.378547 710 raft_consensus.cc:1275] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.379551 789 consensus_queue.cc:1048] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.387638 635 raft_consensus.cc:1275] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.390048 758 consensus_queue.cc:1048] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.431905 710 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:51:16.433228 868 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:51:16.434383 710 raft_consensus.cc:1275] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.435703 789 consensus_queue.cc:1048] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.442708 560 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:51:16.445457 787 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:16.457703 635 raft_consensus.cc:1275] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:16.458977 758 consensus_queue.cc:1048] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:18.472271 426 auto_leader_rebalancer-test.cc:272] The leader distribution is
I20251215 20:51:18.472992 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:18.491346 560 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
mode: GRACEFUL
new_leader_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:51070
I20251215 20:51:18.491806 560 raft_consensus.cc:606] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Received request to transfer leadership to TS a5c532b76e95438e954f519e3d864b63
I20251215 20:51:18.500370 635 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:60072
I20251215 20:51:18.500819 635 raft_consensus.cc:606] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Received request to transfer leadership to TS a5c532b76e95438e954f519e3d864b63
I20251215 20:51:18.501766 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251215 20:51:18.502167 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:18.773038 851 raft_consensus.cc:993] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5: : Instructing follower a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:18.773447 887 raft_consensus.cc:1081] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Signalling peer a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:18.774610 707 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31"
dest_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:39964
I20251215 20:51:18.775031 707 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:18.775292 707 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:18.780010 707 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:18.781453 707 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 4 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:18.782274 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:18.782398 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:18.782827 560 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:18.782863 635 raft_consensus.cc:3055] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:51:18.783293 635 raft_consensus.cc:740] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:18.784082 635 consensus_queue.cc:260] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:18.785254 635 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:18.789561 560 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 4.
I20251215 20:51:18.790571 673 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:18.791265 871 raft_consensus.cc:2804] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:51:18.791421 635 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 4.
I20251215 20:51:18.792380 871 raft_consensus.cc:697] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 4 LEADER]: Becoming Leader. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:18.793062 871 consensus_queue.cc:237] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:18.799453 457 catalog_manager.cc:5654] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 reported cstate change: term changed from 3 to 4, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to a5c532b76e95438e954f519e3d864b63 (127.0.106.131). New cstate: current_term: 4 leader_uuid: "a5c532b76e95438e954f519e3d864b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:18.973222 758 raft_consensus.cc:993] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28: : Instructing follower a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:18.973608 894 raft_consensus.cc:1081] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Signalling peer a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:18.974934 707 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9"
dest_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:39972
I20251215 20:51:18.975328 707 raft_consensus.cc:493] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:18.975554 707 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:18.979707 707 raft_consensus.cc:515] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:18.981065 707 leader_election.cc:290] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 3 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:18.982040 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:18.982326 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:18.982467 635 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:18.982851 560 raft_consensus.cc:3055] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:18.983108 560 raft_consensus.cc:740] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:18.983703 560 consensus_queue.cc:260] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:18.984654 560 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:18.986599 635 raft_consensus.cc:2468] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 3.
I20251215 20:51:18.987414 674 leader_election.cc:304] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:18.987995 871 raft_consensus.cc:2804] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:18.988363 871 raft_consensus.cc:697] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Becoming Leader. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:18.988991 871 consensus_queue.cc:237] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:18.989388 560 raft_consensus.cc:2468] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 3.
I20251215 20:51:18.994750 457 catalog_manager.cc:5654] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 reported cstate change: term changed from 2 to 3, leader changed from d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129) to a5c532b76e95438e954f519e3d864b63 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "a5c532b76e95438e954f519e3d864b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:19.305307 635 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:51:19.306354 871 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:19.314702 560 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:51:19.317699 871 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:19.419756 635 raft_consensus.cc:1275] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:19.420748 899 consensus_queue.cc:1048] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:19.430819 560 raft_consensus.cc:1275] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:19.432070 888 consensus_queue.cc:1048] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:19.502911 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:19.507591 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:19.507912 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:20.508890 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:20.514219 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:20.514572 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:21.515460 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:21.520051 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:21.520421 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:22.521234 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:22.525897 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:22.526299 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:23.527033 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:23.531497 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:23.531841 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:24.532629 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:24.537281 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:24.537644 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:25.538408 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:25.543138 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:25.543505 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:26.544237 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:26.548779 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:26.549118 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:27.549835 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:27.554754 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:27.555101 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:28.577567 426 auto_leader_rebalancer-test.cc:291] The leader distribution is
I20251215 20:51:28.581331 559 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:51054
I20251215 20:51:28.581899 559 raft_consensus.cc:606] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:28.585664 559 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "07d9fca6769e426c96573179099e83d7"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:51054
I20251215 20:51:28.586051 559 raft_consensus.cc:606] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:28.589589 559 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:51054
I20251215 20:51:28.589939 559 raft_consensus.cc:606] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:28.593896 710 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9"
dest_uuid: "a5c532b76e95438e954f519e3d864b63"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:39974
I20251215 20:51:28.594274 710 raft_consensus.cc:606] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:28.598367 710 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31"
dest_uuid: "a5c532b76e95438e954f519e3d864b63"
mode: GRACEFUL
new_leader_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:39974
I20251215 20:51:28.598713 710 raft_consensus.cc:606] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 4 LEADER]: Received request to transfer leadership to TS 6b027efaf85440c49a962daf569191f5
I20251215 20:51:28.697121 888 raft_consensus.cc:993] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:28.697623 908 raft_consensus.cc:1081] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:28.698889 633 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60032
I20251215 20:51:28.699309 633 raft_consensus.cc:493] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:28.699590 633 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:28.704733 633 raft_consensus.cc:515] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.706547 633 leader_election.cc:290] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 4 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:28.707320 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:28.707404 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a206c3b38086435b9b3b4287cdc724b9" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:28.707942 559 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:28.708009 710 raft_consensus.cc:3055] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:51:28.708333 710 raft_consensus.cc:740] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:28.708875 710 consensus_queue.cc:260] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.709721 710 raft_consensus.cc:3060] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:28.711874 559 raft_consensus.cc:2468] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 4.
I20251215 20:51:28.712808 599 leader_election.cc:304] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:28.713467 907 raft_consensus.cc:2804] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:51:28.713557 710 raft_consensus.cc:2468] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 4.
I20251215 20:51:28.714360 907 raft_consensus.cc:697] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 4 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:28.715170 907 consensus_queue.cc:237] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.722988 457 catalog_manager.cc:5654] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 3 to 4, leader changed from a5c532b76e95438e954f519e3d864b63 (127.0.106.131) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 4 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:28.731261 888 raft_consensus.cc:993] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:28.731640 908 raft_consensus.cc:1081] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 4 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:28.733323 633 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60032
I20251215 20:51:28.733681 633 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:28.733963 633 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:51:28.737721 633 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.738941 633 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 5 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:28.739538 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:28.739777 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:28.739964 559 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:51:28.740206 710 raft_consensus.cc:3055] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 4 LEADER]: Stepping down as leader of term 4
I20251215 20:51:28.740500 710 raft_consensus.cc:740] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:28.741041 710 consensus_queue.cc:260] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.741782 710 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:51:28.743629 559 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 5.
I20251215 20:51:28.744377 599 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:28.745031 907 raft_consensus.cc:2804] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:51:28.745381 907 raft_consensus.cc:697] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 5 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:28.745597 710 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 5.
I20251215 20:51:28.746066 907 consensus_queue.cc:237] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.751966 457 catalog_manager.cc:5654] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 4 to 5, leader changed from a5c532b76e95438e954f519e3d864b63 (127.0.106.131) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 5 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:28.766772 894 raft_consensus.cc:993] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:28.767210 916 raft_consensus.cc:1081] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:28.768406 633 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60048
I20251215 20:51:28.768741 633 raft_consensus.cc:493] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:28.768940 633 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:28.772584 633 raft_consensus.cc:515] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:28.773862 633 leader_election.cc:290] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:28.774492 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:28.774636 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:28.775000 559 raft_consensus.cc:3055] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:28.775084 710 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:28.775347 559 raft_consensus.cc:740] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:28.776000 559 consensus_queue.cc:260] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:28.777148 559 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:28.780673 710 raft_consensus.cc:2468] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 2.
I20251215 20:51:28.781695 599 leader_election.cc:304] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:28.782279 907 raft_consensus.cc:2804] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:28.782565 559 raft_consensus.cc:2468] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 2.
I20251215 20:51:28.782626 907 raft_consensus.cc:697] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:28.783819 907 consensus_queue.cc:237] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:28.789340 457 catalog_manager.cc:5654] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 1 to 2, leader changed from d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:28.895581 894 raft_consensus.cc:993] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:28.895957 916 raft_consensus.cc:1081] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:28.897193 633 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60048
I20251215 20:51:28.897562 633 raft_consensus.cc:493] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:28.897771 633 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:28.901530 633 raft_consensus.cc:515] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.902657 633 leader_election.cc:290] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 3 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:28.903436 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:28.903585 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:28.903949 559 raft_consensus.cc:3055] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:28.904006 710 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:28.904340 559 raft_consensus.cc:740] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:28.905002 559 consensus_queue.cc:260] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.906090 559 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:28.909684 710 raft_consensus.cc:2468] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 3.
I20251215 20:51:28.910533 599 leader_election.cc:304] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:28.911180 907 raft_consensus.cc:2804] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:28.911533 907 raft_consensus.cc:697] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:28.911571 559 raft_consensus.cc:2468] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 3.
I20251215 20:51:28.912456 907 consensus_queue.cc:237] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:28.918645 457 catalog_manager.cc:5654] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 2 to 3, leader changed from d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:29.075331 894 raft_consensus.cc:993] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28: : Instructing follower 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:29.075700 916 raft_consensus.cc:1081] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Signalling peer 6b027efaf85440c49a962daf569191f5 to start an election
I20251215 20:51:29.076848 633 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "07d9fca6769e426c96573179099e83d7"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
from {username='slave'} at 127.0.0.1:60048
I20251215 20:51:29.077235 633 raft_consensus.cc:493] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:29.077529 633 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:29.081220 633 raft_consensus.cc:515] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:29.082461 633 leader_election.cc:290] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 3 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:29.083187 559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:29.083346 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "6b027efaf85440c49a962daf569191f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:29.083607 559 raft_consensus.cc:3055] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:29.083743 710 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:29.083884 559 raft_consensus.cc:740] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:29.084571 559 consensus_queue.cc:260] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:29.085388 559 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:29.088205 710 raft_consensus.cc:2468] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 3.
I20251215 20:51:29.089129 599 leader_election.cc:304] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b027efaf85440c49a962daf569191f5, a5c532b76e95438e954f519e3d864b63; no voters:
I20251215 20:51:29.089704 907 raft_consensus.cc:2804] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:29.090140 907 raft_consensus.cc:697] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Becoming Leader. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:29.090827 559 raft_consensus.cc:2468] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b027efaf85440c49a962daf569191f5 in term 3.
I20251215 20:51:29.090914 907 consensus_queue.cc:237] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:29.097236 457 catalog_manager.cc:5654] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 reported cstate change: term changed from 2 to 3, leader changed from d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129) to 6b027efaf85440c49a962daf569191f5 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "6b027efaf85440c49a962daf569191f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:29.133131 559 raft_consensus.cc:1275] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:51:29.134064 907 consensus_queue.cc:1048] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:29.142064 710 raft_consensus.cc:1275] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:51:29.143133 907 consensus_queue.cc:1048] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:29.226397 559 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 5 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:51:29.227528 907 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:29.236649 710 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 5 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:51:29.238402 926 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:29.356422 710 raft_consensus.cc:1275] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:29.357328 926 consensus_queue.cc:1048] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:29.366057 559 raft_consensus.cc:1275] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:29.367916 926 consensus_queue.cc:1048] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:29.428406 559 raft_consensus.cc:1275] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:29.429378 926 consensus_queue.cc:1048] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:29.437810 710 raft_consensus.cc:1275] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:29.438838 926 consensus_queue.cc:1048] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:29.482266 710 raft_consensus.cc:1275] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:29.483284 929 consensus_queue.cc:1048] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:29.491034 559 raft_consensus.cc:1275] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Refusing update from remote peer 6b027efaf85440c49a962daf569191f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:29.492518 909 consensus_queue.cc:1048] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:31.630824 426 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20251215 20:51:31.631542 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:31.638093 633 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "07d9fca6769e426c96573179099e83d7"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:60072
I20251215 20:51:31.638622 633 raft_consensus.cc:606] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Received request to transfer leadership to TS d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:31.640612 633 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:60072
I20251215 20:51:31.640987 633 raft_consensus.cc:606] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Received request to transfer leadership to TS d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:31.642642 633 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:60072
I20251215 20:51:31.642990 633 raft_consensus.cc:606] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Received request to transfer leadership to TS a5c532b76e95438e954f519e3d864b63
I20251215 20:51:31.644706 633 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:60072
I20251215 20:51:31.645054 633 raft_consensus.cc:606] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Received request to transfer leadership to TS a5c532b76e95438e954f519e3d864b63
I20251215 20:51:31.646755 633 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31"
dest_uuid: "6b027efaf85440c49a962daf569191f5"
mode: GRACEFUL
new_leader_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:60072
I20251215 20:51:31.647105 633 raft_consensus.cc:606] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 5 LEADER]: Received request to transfer leadership to TS d73987d0b39f4d0593c0d7849e139e28
I20251215 20:51:31.647899 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20251215 20:51:31.648233 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:31.662395 909 raft_consensus.cc:993] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5: : Instructing follower a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:31.662834 936 raft_consensus.cc:1081] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Signalling peer a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:31.664032 710 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5"
dest_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:39964
I20251215 20:51:31.664436 710 raft_consensus.cc:493] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:31.664716 710 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:31.668982 710 raft_consensus.cc:515] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:31.670600 710 leader_election.cc:290] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 3 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:31.671476 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:31.671521 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6891a5cf3c1541438fcb9ee69c50d4f5" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:31.672125 633 raft_consensus.cc:3055] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:31.672237 560 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:31.672430 633 raft_consensus.cc:740] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:31.673075 633 consensus_queue.cc:260] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:31.673868 633 raft_consensus.cc:3060] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:31.676374 560 raft_consensus.cc:2468] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 3.
I20251215 20:51:31.677423 673 leader_election.cc:304] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:31.678084 633 raft_consensus.cc:2468] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 3.
I20251215 20:51:31.678187 908 raft_consensus.cc:2804] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:31.679834 908 raft_consensus.cc:697] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Becoming Leader. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:31.680709 908 consensus_queue.cc:237] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } }
I20251215 20:51:31.684341 909 raft_consensus.cc:993] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5: : Instructing follower d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:31.685020 909 raft_consensus.cc:1081] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 5 LEADER]: Signalling peer d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:31.690595 559 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:51036
I20251215 20:51:31.691026 559 raft_consensus.cc:493] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:31.691322 559 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:51:31.691689 939 raft_consensus.cc:993] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5: : Instructing follower d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:31.692128 936 raft_consensus.cc:1081] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Signalling peer d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:31.691319 455 catalog_manager.cc:5654] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 reported cstate change: term changed from 2 to 3, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to a5c532b76e95438e954f519e3d864b63 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "a5c532b76e95438e954f519e3d864b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:31.693557 560 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:51036
I20251215 20:51:31.694058 560 raft_consensus.cc:493] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:31.694388 560 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:31.697225 559 raft_consensus.cc:515] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.699713 936 raft_consensus.cc:993] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5: : Instructing follower d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:31.700106 936 raft_consensus.cc:1081] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Signalling peer d73987d0b39f4d0593c0d7849e139e28 to start an election
I20251215 20:51:31.700169 633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:31.700733 633 raft_consensus.cc:3055] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 5 LEADER]: Stepping down as leader of term 5
I20251215 20:51:31.701009 633 raft_consensus.cc:740] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:31.701022 559 leader_election.cc:290] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 6 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:31.701205 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd9c4d0c19bd4c4e8a89c44149cbee31" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:31.701802 710 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:51:31.701766 633 consensus_queue.cc:260] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.703016 633 raft_consensus.cc:3060] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:51:31.703339 561 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "07d9fca6769e426c96573179099e83d7"
dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
from {username='slave'} at 127.0.0.1:51036
I20251215 20:51:31.703899 561 raft_consensus.cc:493] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:31.704243 561 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:31.707618 710 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 6.
I20251215 20:51:31.708763 524 leader_election.cc:304] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:31.709224 633 raft_consensus.cc:2468] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 6.
I20251215 20:51:31.710669 561 raft_consensus.cc:515] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.711419 944 raft_consensus.cc:2804] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 6 FOLLOWER]: Leader election won for term 6
I20251215 20:51:31.711623 560 raft_consensus.cc:515] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.713656 560 leader_election.cc:290] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 4 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:31.714244 710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:31.714424 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ad144d06c24c768af1bb06f9a54708" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:31.714730 710 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:31.714942 635 raft_consensus.cc:3055] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:51:31.715317 635 raft_consensus.cc:740] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:31.716084 635 consensus_queue.cc:260] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.717119 635 raft_consensus.cc:3060] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:31.718854 707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a5c532b76e95438e954f519e3d864b63"
I20251215 20:51:31.719027 634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07d9fca6769e426c96573179099e83d7" candidate_uuid: "d73987d0b39f4d0593c0d7849e139e28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:31.719367 707 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:31.719584 634 raft_consensus.cc:3055] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:51:31.721215 944 raft_consensus.cc:697] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 6 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:31.721608 634 raft_consensus.cc:740] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:31.722123 944 consensus_queue.cc:237] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.722363 634 consensus_queue.cc:260] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.723461 634 raft_consensus.cc:3060] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:31.725052 710 raft_consensus.cc:2468] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 4.
I20251215 20:51:31.726156 524 leader_election.cc:304] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:31.714743 561 leader_election.cc:290] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 4 election: Requested vote from peers 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463), a5c532b76e95438e954f519e3d864b63 (127.0.106.131:43957)
I20251215 20:51:31.727799 946 raft_consensus.cc:2804] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:51:31.726955 707 raft_consensus.cc:2468] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 4.
I20251215 20:51:31.729566 524 leader_election.cc:304] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:31.729786 634 raft_consensus.cc:2468] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 4.
I20251215 20:51:31.731519 949 raft_consensus.cc:2804] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:51:31.731945 949 raft_consensus.cc:697] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 4 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:31.732749 949 consensus_queue.cc:237] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.733168 946 raft_consensus.cc:697] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 4 LEADER]: Becoming Leader. State: Replica: d73987d0b39f4d0593c0d7849e139e28, State: Running, Role: LEADER
I20251215 20:51:31.735108 946 consensus_queue.cc:237] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.736939 635 raft_consensus.cc:2468] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73987d0b39f4d0593c0d7849e139e28 in term 4.
I20251215 20:51:31.738456 455 catalog_manager.cc:5654] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 5 to 6, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 6 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:31.749468 455 catalog_manager.cc:5654] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 3 to 4, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 4 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:31.750418 455 catalog_manager.cc:5654] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 reported cstate change: term changed from 3 to 4, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129). New cstate: current_term: 4 leader_uuid: "d73987d0b39f4d0593c0d7849e139e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:31.955410 936 raft_consensus.cc:993] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5: : Instructing follower a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:31.955941 938 raft_consensus.cc:1081] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Signalling peer a5c532b76e95438e954f519e3d864b63 to start an election
I20251215 20:51:31.957139 707 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284"
dest_uuid: "a5c532b76e95438e954f519e3d864b63"
from {username='slave'} at 127.0.0.1:39964
I20251215 20:51:31.957515 707 raft_consensus.cc:493] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:31.957731 707 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:31.961474 707 raft_consensus.cc:515] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.962643 707 leader_election.cc:290] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 3 election: Requested vote from peers d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641), 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463)
I20251215 20:51:31.963225 560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d73987d0b39f4d0593c0d7849e139e28"
I20251215 20:51:31.963557 635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467ddb6bd57f48aab730f65c83ac0284" candidate_uuid: "a5c532b76e95438e954f519e3d864b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b027efaf85440c49a962daf569191f5"
I20251215 20:51:31.963748 560 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:31.964066 635 raft_consensus.cc:3055] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:31.964401 635 raft_consensus.cc:740] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b027efaf85440c49a962daf569191f5, State: Running, Role: LEADER
I20251215 20:51:31.965137 635 consensus_queue.cc:260] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.966320 635 raft_consensus.cc:3060] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:31.969365 560 raft_consensus.cc:2468] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 3.
I20251215 20:51:31.970228 673 leader_election.cc:304] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5c532b76e95438e954f519e3d864b63, d73987d0b39f4d0593c0d7849e139e28; no voters:
I20251215 20:51:31.970930 908 raft_consensus.cc:2804] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:31.971269 908 raft_consensus.cc:697] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Becoming Leader. State: Replica: a5c532b76e95438e954f519e3d864b63, State: Running, Role: LEADER
I20251215 20:51:31.971885 635 raft_consensus.cc:2468] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c532b76e95438e954f519e3d864b63 in term 3.
I20251215 20:51:31.971961 908 consensus_queue.cc:237] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } }
I20251215 20:51:31.977941 455 catalog_manager.cc:5654] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 reported cstate change: term changed from 2 to 3, leader changed from 6b027efaf85440c49a962daf569191f5 (127.0.106.130) to a5c532b76e95438e954f519e3d864b63 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "a5c532b76e95438e954f519e3d864b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:32.141376 707 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 6 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20251215 20:51:32.142357 946 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:51:32.150928 635 raft_consensus.cc:1275] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 6 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20251215 20:51:32.152328 944 consensus_queue.cc:1048] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:51:32.170872 707 raft_consensus.cc:1275] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:51:32.171826 946 consensus_queue.cc:1048] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:32.177003 560 raft_consensus.cc:1275] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:32.178258 908 consensus_queue.cc:1048] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:32.179539 635 raft_consensus.cc:1275] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:51:32.180634 944 consensus_queue.cc:1048] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:32.192467 635 raft_consensus.cc:1275] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:32.195540 908 consensus_queue.cc:1048] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:32.248813 635 raft_consensus.cc:1275] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:51:32.249859 944 consensus_queue.cc:1048] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:32.257542 707 raft_consensus.cc:1275] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Refusing update from remote peer d73987d0b39f4d0593c0d7849e139e28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:51:32.258803 949 consensus_queue.cc:1048] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c532b76e95438e954f519e3d864b63" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:32.460121 635 raft_consensus.cc:1275] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:32.461114 908 consensus_queue.cc:1048] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b027efaf85440c49a962daf569191f5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:32.468191 560 raft_consensus.cc:1275] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Refusing update from remote peer a5c532b76e95438e954f519e3d864b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:32.469810 937 consensus_queue.cc:1048] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73987d0b39f4d0593c0d7849e139e28" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:32.649142 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:32.654052 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:32.654358 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:33.683765 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:33.688597 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:33.688937 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251215 20:51:33.744204 489 debug-util.cc:398] Leaking SignalData structure 0x7b0800061060 after lost signal to thread 429
W20251215 20:51:33.744886 489 debug-util.cc:398] Leaking SignalData structure 0x7b0800061740 after lost signal to thread 492
W20251215 20:51:33.745558 489 debug-util.cc:398] Leaking SignalData structure 0x7b080009f080 after lost signal to thread 585
W20251215 20:51:33.746255 489 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0fa0 after lost signal to thread 660
W20251215 20:51:33.747020 489 debug-util.cc:398] Leaking SignalData structure 0x7b0800198f40 after lost signal to thread 734
I20251215 20:51:34.689926 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:34.697029 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:34.697523 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:35.698642 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:35.705796 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:35.706293 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:36.707255 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:36.711861 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:36.712172 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:37.713016 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:37.717677 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:37.717994 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:38.720747 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:38.727046 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:38.727397 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:39.728367 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:39.732935 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:39.733274 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:40.734396 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:40.739974 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:40.740463 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:41.764549 426 auto_leader_rebalancer-test.cc:318] The leader distribution is
I20251215 20:51:41.765051 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
I20251215 20:51:41.789198 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:51:41.789878 426 tablet_replica.cc:333] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.790773 426 raft_consensus.cc:2243] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.791354 426 raft_consensus.cc:2272] T 33a15ec522a14ad3bc4da7093b3e959e P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.794853 426 tablet_replica.cc:333] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.795336 426 raft_consensus.cc:2243] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 6 LEADER]: Raft consensus shutting down.
I20251215 20:51:41.796224 426 raft_consensus.cc:2272] T fd9c4d0c19bd4c4e8a89c44149cbee31 P d73987d0b39f4d0593c0d7849e139e28 [term 6 FOLLOWER]: Raft consensus is shut down!
W20251215 20:51:41.797995 673 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:51:41.798468 426 tablet_replica.cc:333] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.798987 426 raft_consensus.cc:2243] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:51:41.799851 426 raft_consensus.cc:2272] T 07d9fca6769e426c96573179099e83d7 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:51:41.800972 673 consensus_peers.cc:597] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 -> Peer d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641): Couldn't send request to peer d73987d0b39f4d0593c0d7849e139e28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:51:41.801813 426 tablet_replica.cc:333] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.802295 426 raft_consensus.cc:2243] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.802690 426 raft_consensus.cc:2272] T 467ddb6bd57f48aab730f65c83ac0284 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.804237 426 tablet_replica.cc:333] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.804735 426 raft_consensus.cc:2243] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:51:41.805455 426 raft_consensus.cc:2272] T 23ad144d06c24c768af1bb06f9a54708 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.807003 426 tablet_replica.cc:333] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.807435 426 raft_consensus.cc:2243] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.807824 426 raft_consensus.cc:2272] T 6891a5cf3c1541438fcb9ee69c50d4f5 P d73987d0b39f4d0593c0d7849e139e28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.809381 426 tablet_replica.cc:333] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.809821 426 raft_consensus.cc:2243] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.810207 426 raft_consensus.cc:2272] T a206c3b38086435b9b3b4287cdc724b9 P d73987d0b39f4d0593c0d7849e139e28 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.811678 426 tablet_replica.cc:333] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.812083 426 raft_consensus.cc:2243] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.812474 426 raft_consensus.cc:2272] T 1445c97060d34de8b8037a3f1d38172b P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.813941 426 tablet_replica.cc:333] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28: stopping tablet replica
I20251215 20:51:41.814321 426 raft_consensus.cc:2243] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.814656 426 raft_consensus.cc:2272] T 128c79ee45ee4f648ef464e5868728cb P d73987d0b39f4d0593c0d7849e139e28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.895023 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20251215 20:51:41.895514 599 consensus_peers.cc:597] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 -> Peer d73987d0b39f4d0593c0d7849e139e28 (127.0.106.129:36641): Couldn't send request to peer d73987d0b39f4d0593c0d7849e139e28. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:36641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:51:41.912451 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20251215 20:51:41.923523 674 consensus_peers.cc:597] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 -> Peer 6b027efaf85440c49a962daf569191f5 (127.0.106.130:42463): Couldn't send request to peer 6b027efaf85440c49a962daf569191f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:51:41.935520 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:51:41.936039 426 tablet_replica.cc:333] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.936635 426 raft_consensus.cc:2243] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.937068 426 raft_consensus.cc:2272] T fd9c4d0c19bd4c4e8a89c44149cbee31 P 6b027efaf85440c49a962daf569191f5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.938700 426 tablet_replica.cc:333] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.939127 426 raft_consensus.cc:2243] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:51:41.939790 426 raft_consensus.cc:2272] T 33a15ec522a14ad3bc4da7093b3e959e P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.941291 426 tablet_replica.cc:333] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.941771 426 raft_consensus.cc:2243] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:51:41.942425 426 raft_consensus.cc:2272] T a206c3b38086435b9b3b4287cdc724b9 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.943944 426 tablet_replica.cc:333] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.944406 426 raft_consensus.cc:2243] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.944813 426 raft_consensus.cc:2272] T 6891a5cf3c1541438fcb9ee69c50d4f5 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.946224 426 tablet_replica.cc:333] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.946692 426 raft_consensus.cc:2243] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.947093 426 raft_consensus.cc:2272] T 23ad144d06c24c768af1bb06f9a54708 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.948637 426 tablet_replica.cc:333] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.949062 426 raft_consensus.cc:2243] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:51:41.949748 426 raft_consensus.cc:2272] T 128c79ee45ee4f648ef464e5868728cb P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.951242 426 tablet_replica.cc:333] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.951639 426 raft_consensus.cc:2243] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.952000 426 raft_consensus.cc:2272] T 1445c97060d34de8b8037a3f1d38172b P 6b027efaf85440c49a962daf569191f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.953466 426 tablet_replica.cc:333] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.953881 426 raft_consensus.cc:2243] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.954236 426 raft_consensus.cc:2272] T 467ddb6bd57f48aab730f65c83ac0284 P 6b027efaf85440c49a962daf569191f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.955612 426 tablet_replica.cc:333] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5: stopping tablet replica
I20251215 20:51:41.955996 426 raft_consensus.cc:2243] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:41.956384 426 raft_consensus.cc:2272] T 07d9fca6769e426c96573179099e83d7 P 6b027efaf85440c49a962daf569191f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:41.980998 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
I20251215 20:51:41.996798 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
I20251215 20:51:42.016773 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:51:42.017313 426 tablet_replica.cc:333] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.017856 426 raft_consensus.cc:2243] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:51:42.018556 426 raft_consensus.cc:2272] T 467ddb6bd57f48aab730f65c83ac0284 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.020254 426 tablet_replica.cc:333] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.020740 426 raft_consensus.cc:2243] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:42.021129 426 raft_consensus.cc:2272] T 07d9fca6769e426c96573179099e83d7 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.022571 426 tablet_replica.cc:333] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.022985 426 raft_consensus.cc:2243] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:42.023316 426 raft_consensus.cc:2272] T 128c79ee45ee4f648ef464e5868728cb P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.024837 426 tablet_replica.cc:333] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.025228 426 raft_consensus.cc:2243] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:51:42.025841 426 raft_consensus.cc:2272] T 1445c97060d34de8b8037a3f1d38172b P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.027215 426 tablet_replica.cc:333] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.027637 426 raft_consensus.cc:2243] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:42.027949 426 raft_consensus.cc:2272] T a206c3b38086435b9b3b4287cdc724b9 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.029656 426 tablet_replica.cc:333] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.030050 426 raft_consensus.cc:2243] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:51:42.030682 426 raft_consensus.cc:2272] T 6891a5cf3c1541438fcb9ee69c50d4f5 P a5c532b76e95438e954f519e3d864b63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.032055 426 tablet_replica.cc:333] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.032502 426 raft_consensus.cc:2243] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:42.032882 426 raft_consensus.cc:2272] T 23ad144d06c24c768af1bb06f9a54708 P a5c532b76e95438e954f519e3d864b63 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.034263 426 tablet_replica.cc:333] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.034628 426 raft_consensus.cc:2243] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:42.034943 426 raft_consensus.cc:2272] T 33a15ec522a14ad3bc4da7093b3e959e P a5c532b76e95438e954f519e3d864b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.036346 426 tablet_replica.cc:333] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63: stopping tablet replica
I20251215 20:51:42.036718 426 raft_consensus.cc:2243] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 6 FOLLOWER]: Raft consensus shutting down.
I20251215 20:51:42.037046 426 raft_consensus.cc:2272] T fd9c4d0c19bd4c4e8a89c44149cbee31 P a5c532b76e95438e954f519e3d864b63 [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.061367 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20251215 20:51:42.077775 426 master.cc:561] Master@127.0.106.190:36099 shutting down...
I20251215 20:51:42.281523 426 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:51:42.282100 426 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:51:42.282411 426 tablet_replica.cc:333] T 00000000000000000000000000000000 P 205f885235ea4ffdb5f81c48462e1536: stopping tablet replica
I20251215 20:51:42.316148 426 master.cc:583] Master@127.0.106.190:36099 shutdown complete.
6b027efaf85440c49a962daf569191f5 4
a5c532b76e95438e954f519e3d864b63 1
d73987d0b39f4d0593c0d7849e139e28 4
6b027efaf85440c49a962daf569191f5 3
a5c532b76e95438e954f519e3d864b63 3
d73987d0b39f4d0593c0d7849e139e28 3
6b027efaf85440c49a962daf569191f5 8
a5c532b76e95438e954f519e3d864b63 1
d73987d0b39f4d0593c0d7849e139e28 0
6b027efaf85440c49a962daf569191f5 3
a5c532b76e95438e954f519e3d864b63 3
d73987d0b39f4d0593c0d7849e139e28 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (32481 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20251215 20:51:42.352186 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:40965
I20251215 20:51:42.353246 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:51:42.358215 977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:42.358317 978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:42.359479 980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:42.360605 426 server_base.cc:1047] running on GCE node
I20251215 20:51:42.361474 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:51:42.361649 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:51:42.361760 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831902361749 us; error 0 us; skew 500 ppm
I20251215 20:51:42.362202 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:51:42.364318 426 webserver.cc:492] Webserver started at http://127.0.106.190:42597/ using document root <none> and password file <none>
I20251215 20:51:42.364774 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:51:42.364933 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:51:42.365129 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:51:42.366137 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/master-0-root/instance:
uuid: "76b1cd0d70cd40f58a49b61b1c601039"
format_stamp: "Formatted at 2025-12-15 20:51:42 on dist-test-slave-xp5d"
I20251215 20:51:42.370158 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20251215 20:51:42.373020 985 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.373636 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251215 20:51:42.373875 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/master-0-root
uuid: "76b1cd0d70cd40f58a49b61b1c601039"
format_stamp: "Formatted at 2025-12-15 20:51:42 on dist-test-slave-xp5d"
I20251215 20:51:42.374133 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:51:42.403584 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:51:42.404690 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:51:42.439040 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:40965
I20251215 20:51:42.439136 1036 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:40965 every 8 connection(s)
I20251215 20:51:42.442538 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.451413 1037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039: Bootstrap starting.
I20251215 20:51:42.455737 1037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:42.459383 1037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039: No bootstrap required, opened a new log
I20251215 20:51:42.461285 1037 raft_consensus.cc:359] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b1cd0d70cd40f58a49b61b1c601039" member_type: VOTER }
I20251215 20:51:42.461661 1037 raft_consensus.cc:385] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:42.461884 1037 raft_consensus.cc:740] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b1cd0d70cd40f58a49b61b1c601039, State: Initialized, Role: FOLLOWER
I20251215 20:51:42.462379 1037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b1cd0d70cd40f58a49b61b1c601039" member_type: VOTER }
I20251215 20:51:42.462779 1037 raft_consensus.cc:399] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251215 20:51:42.463011 1037 raft_consensus.cc:493] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251215 20:51:42.463266 1037 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:42.467362 1037 raft_consensus.cc:515] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b1cd0d70cd40f58a49b61b1c601039" member_type: VOTER }
I20251215 20:51:42.467803 1037 leader_election.cc:304] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76b1cd0d70cd40f58a49b61b1c601039; no voters:
I20251215 20:51:42.468791 1037 leader_election.cc:290] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251215 20:51:42.469103 1040 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:42.470305 1040 raft_consensus.cc:697] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 1 LEADER]: Becoming Leader. State: Replica: 76b1cd0d70cd40f58a49b61b1c601039, State: Running, Role: LEADER
I20251215 20:51:42.470834 1040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b1cd0d70cd40f58a49b61b1c601039" member_type: VOTER }
I20251215 20:51:42.471402 1037 sys_catalog.cc:565] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [sys.catalog]: configured and running, proceeding with master startup.
I20251215 20:51:42.475720 1041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76b1cd0d70cd40f58a49b61b1c601039" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b1cd0d70cd40f58a49b61b1c601039" member_type: VOTER } }
I20251215 20:51:42.476456 1041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [sys.catalog]: This master's current role is: LEADER
I20251215 20:51:42.476322 1042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76b1cd0d70cd40f58a49b61b1c601039. Latest consensus state: current_term: 1 leader_uuid: "76b1cd0d70cd40f58a49b61b1c601039" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b1cd0d70cd40f58a49b61b1c601039" member_type: VOTER } }
I20251215 20:51:42.477016 1042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [sys.catalog]: This master's current role is: LEADER
I20251215 20:51:42.478278 1048 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251215 20:51:42.482777 1048 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251215 20:51:42.485359 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251215 20:51:42.490502 1048 catalog_manager.cc:1357] Generated new cluster ID: 674954d85c594658b8ede1b0417f2169
I20251215 20:51:42.490759 1048 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251215 20:51:42.508587 1048 catalog_manager.cc:1380] Generated new certificate authority record
I20251215 20:51:42.509706 1048 catalog_manager.cc:1514] Loading token signing keys...
I20251215 20:51:42.530702 1048 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039: Generated new TSK 0
I20251215 20:51:42.531203 1048 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251215 20:51:42.551115 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:51:42.556378 1058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:42.557278 1059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:42.558413 1061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:42.558869 426 server_base.cc:1047] running on GCE node
I20251215 20:51:42.559674 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:51:42.559870 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:51:42.560029 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831902560011 us; error 0 us; skew 500 ppm
I20251215 20:51:42.560563 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:51:42.562597 426 webserver.cc:492] Webserver started at http://127.0.106.129:35367/ using document root <none> and password file <none>
I20251215 20:51:42.563071 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:51:42.563239 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:51:42.563472 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:51:42.564438 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-0-root/instance:
uuid: "b633549b36214c989518744dd09d2c8b"
format_stamp: "Formatted at 2025-12-15 20:51:42 on dist-test-slave-xp5d"
I20251215 20:51:42.568174 426 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20251215 20:51:42.571058 1066 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.571722 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20251215 20:51:42.571976 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-0-root
uuid: "b633549b36214c989518744dd09d2c8b"
format_stamp: "Formatted at 2025-12-15 20:51:42 on dist-test-slave-xp5d"
I20251215 20:51:42.572248 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:51:42.604388 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:51:42.605577 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:51:42.606992 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:51:42.609143 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:51:42.609330 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.609566 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:51:42.609730 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.645709 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:38593
I20251215 20:51:42.645778 1128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:38593 every 8 connection(s)
I20251215 20:51:42.650156 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:51:42.656884 1133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:42.657913 1134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:42.660312 1136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:42.660944 426 server_base.cc:1047] running on GCE node
I20251215 20:51:42.661752 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:51:42.661921 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:51:42.662045 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831902662033 us; error 0 us; skew 500 ppm
I20251215 20:51:42.662453 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:51:42.664652 426 webserver.cc:492] Webserver started at http://127.0.106.130:34779/ using document root <none> and password file <none>
I20251215 20:51:42.665189 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:51:42.665416 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:51:42.665762 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:51:42.666716 1129 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40965
I20251215 20:51:42.667030 1129 heartbeater.cc:461] Registering TS with master...
I20251215 20:51:42.667065 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-1-root/instance:
uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
format_stamp: "Formatted at 2025-12-15 20:51:42 on dist-test-slave-xp5d"
I20251215 20:51:42.667697 1129 heartbeater.cc:507] Master 127.0.106.190:40965 requested a full tablet report, sending...
I20251215 20:51:42.669584 1002 ts_manager.cc:194] Registered new tserver with Master: b633549b36214c989518744dd09d2c8b (127.0.106.129:38593)
I20251215 20:51:42.671641 1002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45098
I20251215 20:51:42.671859 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20251215 20:51:42.675191 1141 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.675820 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251215 20:51:42.676046 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-1-root
uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
format_stamp: "Formatted at 2025-12-15 20:51:42 on dist-test-slave-xp5d"
I20251215 20:51:42.676335 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:51:42.685842 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:51:42.686982 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:51:42.688364 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:51:42.690337 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:51:42.690506 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.690687 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:51:42.690817 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.730180 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:36583
I20251215 20:51:42.730266 1203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:36583 every 8 connection(s)
I20251215 20:51:42.734143 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:51:42.740617 1207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:42.741293 1208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:51:42.745194 1210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:51:42.745659 426 server_base.cc:1047] running on GCE node
I20251215 20:51:42.745852 1204 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40965
I20251215 20:51:42.746179 1204 heartbeater.cc:461] Registering TS with master...
I20251215 20:51:42.746469 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:51:42.746672 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:51:42.746757 1204 heartbeater.cc:507] Master 127.0.106.190:40965 requested a full tablet report, sending...
I20251215 20:51:42.746920 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831902746901 us; error 0 us; skew 500 ppm
I20251215 20:51:42.747566 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:51:42.748629 1002 ts_manager.cc:194] Registered new tserver with Master: 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:51:42.749938 426 webserver.cc:492] Webserver started at http://127.0.106.131:44425/ using document root <none> and password file <none>
I20251215 20:51:42.750072 1002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45100
I20251215 20:51:42.750416 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:51:42.750615 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:51:42.750855 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:51:42.751906 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-2-root/instance:
uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
format_stamp: "Formatted at 2025-12-15 20:51:42 on dist-test-slave-xp5d"
I20251215 20:51:42.755821 426 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251215 20:51:42.758647 1215 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.759305 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251215 20:51:42.759555 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-2-root
uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
format_stamp: "Formatted at 2025-12-15 20:51:42 on dist-test-slave-xp5d"
I20251215 20:51:42.759819 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1765831869714107-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:51:42.771044 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:51:42.772043 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:51:42.773326 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:51:42.775362 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:51:42.775525 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.775693 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:51:42.775820 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:51:42.810941 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:38763
I20251215 20:51:42.811017 1277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:38763 every 8 connection(s)
I20251215 20:51:42.822789 1278 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40965
I20251215 20:51:42.823091 1278 heartbeater.cc:461] Registering TS with master...
I20251215 20:51:42.823686 1278 heartbeater.cc:507] Master 127.0.106.190:40965 requested a full tablet report, sending...
I20251215 20:51:42.825290 1002 ts_manager.cc:194] Registered new tserver with Master: 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:42.825752 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012046645s
I20251215 20:51:42.826818 1002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45114
I20251215 20:51:42.828440 426 test_util.cc:276] Using random seed: -951249018
I20251215 20:51:42.847672 1002 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45124:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 20:51:42.850339 1002 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 20:51:42.916801 1169 tablet_service.cc:1505] Processing CreateTablet for tablet 272b61c59d214f71b5cfd812120327ca (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20251215 20:51:42.917431 1168 tablet_service.cc:1505] Processing CreateTablet for tablet 818bc67b2c0b45549472e4c9b8de6e59 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20251215 20:51:42.918166 1169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272b61c59d214f71b5cfd812120327ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.918740 1168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818bc67b2c0b45549472e4c9b8de6e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.922413 1094 tablet_service.cc:1505] Processing CreateTablet for tablet 272b61c59d214f71b5cfd812120327ca (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20251215 20:51:42.923712 1094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272b61c59d214f71b5cfd812120327ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.924696 1243 tablet_service.cc:1505] Processing CreateTablet for tablet 272b61c59d214f71b5cfd812120327ca (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20251215 20:51:42.925446 1093 tablet_service.cc:1505] Processing CreateTablet for tablet 818bc67b2c0b45549472e4c9b8de6e59 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20251215 20:51:42.926719 1093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818bc67b2c0b45549472e4c9b8de6e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.927145 1242 tablet_service.cc:1505] Processing CreateTablet for tablet 818bc67b2c0b45549472e4c9b8de6e59 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20251215 20:51:42.929618 1092 tablet_service.cc:1505] Processing CreateTablet for tablet dbb1244e90744c94b7bb8fb894e0325c (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20251215 20:51:42.925866 1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272b61c59d214f71b5cfd812120327ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.930835 1092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb1244e90744c94b7bb8fb894e0325c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.931404 1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818bc67b2c0b45549472e4c9b8de6e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.934576 1167 tablet_service.cc:1505] Processing CreateTablet for tablet dbb1244e90744c94b7bb8fb894e0325c (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20251215 20:51:42.935806 1167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb1244e90744c94b7bb8fb894e0325c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.947139 1293 tablet_bootstrap.cc:492] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:42.951464 1294 tablet_bootstrap.cc:492] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:42.953441 1293 tablet_bootstrap.cc:654] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:42.957804 1295 tablet_bootstrap.cc:492] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:42.964217 1294 tablet_bootstrap.cc:654] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:42.965672 1293 tablet_bootstrap.cc:492] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:42.966183 1293 ts_tablet_manager.cc:1403] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.008s
I20251215 20:51:42.967749 1295 tablet_bootstrap.cc:654] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:42.969099 1293 raft_consensus.cc:359] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:42.969971 1293 raft_consensus.cc:385] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:42.970327 1293 raft_consensus.cc:740] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:42.971165 1293 consensus_queue.cc:260] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:42.971300 1242 tablet_service.cc:1505] Processing CreateTablet for tablet dbb1244e90744c94b7bb8fb894e0325c (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20251215 20:51:42.973218 1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb1244e90744c94b7bb8fb894e0325c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.975431 1294 tablet_bootstrap.cc:492] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:42.975947 1294 ts_tablet_manager.cc:1403] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.009s
I20251215 20:51:42.978132 1094 tablet_service.cc:1505] Processing CreateTablet for tablet d9d1dea074f74ae399a82af616cb2ad6 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20251215 20:51:42.979341 1094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d1dea074f74ae399a82af616cb2ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.979089 1294 raft_consensus.cc:359] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:42.979225 1168 tablet_service.cc:1505] Processing CreateTablet for tablet d9d1dea074f74ae399a82af616cb2ad6 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20251215 20:51:42.979790 1294 raft_consensus.cc:385] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:42.980082 1294 raft_consensus.cc:740] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:42.980389 1168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d1dea074f74ae399a82af616cb2ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.980255 1243 tablet_service.cc:1505] Processing CreateTablet for tablet d9d1dea074f74ae399a82af616cb2ad6 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20251215 20:51:42.980928 1294 consensus_queue.cc:260] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:42.981423 1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d1dea074f74ae399a82af616cb2ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:42.992198 1293 ts_tablet_manager.cc:1434] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20251215 20:51:42.992897 1204 heartbeater.cc:499] Master 127.0.106.190:40965 was elected leader, sending a full tablet report...
I20251215 20:51:42.995138 1293 tablet_bootstrap.cc:492] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:42.996176 1129 heartbeater.cc:499] Master 127.0.106.190:40965 was elected leader, sending a full tablet report...
I20251215 20:51:42.999413 1167 tablet_service.cc:1505] Processing CreateTablet for tablet b1f00f72920e4b7a98ab98da3e85344f (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20251215 20:51:43.000633 1167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f00f72920e4b7a98ab98da3e85344f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.001706 1093 tablet_service.cc:1505] Processing CreateTablet for tablet b1f00f72920e4b7a98ab98da3e85344f (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20251215 20:51:42.994424 1295 tablet_bootstrap.cc:492] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.002755 1295 ts_tablet_manager.cc:1403] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.045s user 0.012s sys 0.004s
I20251215 20:51:43.005534 1294 ts_tablet_manager.cc:1434] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20251215 20:51:43.006063 1241 tablet_service.cc:1505] Processing CreateTablet for tablet b1f00f72920e4b7a98ab98da3e85344f (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20251215 20:51:43.007195 1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f00f72920e4b7a98ab98da3e85344f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.007462 1293 tablet_bootstrap.cc:654] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.009255 1092 tablet_service.cc:1505] Processing CreateTablet for tablet 908492abd62648bda6dfff7a8c405dbb (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20251215 20:51:43.006402 1294 tablet_bootstrap.cc:492] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.016278 1169 tablet_service.cc:1505] Processing CreateTablet for tablet 908492abd62648bda6dfff7a8c405dbb (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20251215 20:51:43.017439 1169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908492abd62648bda6dfff7a8c405dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.019613 1243 tablet_service.cc:1505] Processing CreateTablet for tablet 908492abd62648bda6dfff7a8c405dbb (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20251215 20:51:43.021541 1091 tablet_service.cc:1505] Processing CreateTablet for tablet e8b4cbb73663406b84f800b6ffb7dd79 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20251215 20:51:43.022593 1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908492abd62648bda6dfff7a8c405dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.002840 1093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f00f72920e4b7a98ab98da3e85344f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.030228 1091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b4cbb73663406b84f800b6ffb7dd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.031510 1092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908492abd62648bda6dfff7a8c405dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.033831 1167 tablet_service.cc:1505] Processing CreateTablet for tablet e8b4cbb73663406b84f800b6ffb7dd79 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20251215 20:51:43.035064 1167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b4cbb73663406b84f800b6ffb7dd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.043207 1240 tablet_service.cc:1505] Processing CreateTablet for tablet e8b4cbb73663406b84f800b6ffb7dd79 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20251215 20:51:43.044399 1240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b4cbb73663406b84f800b6ffb7dd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.047544 1166 tablet_service.cc:1505] Processing CreateTablet for tablet 7626bccb7cd84794bc93bc086839e9e0 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20251215 20:51:43.048329 1242 tablet_service.cc:1505] Processing CreateTablet for tablet 7626bccb7cd84794bc93bc086839e9e0 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20251215 20:51:43.049502 1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7626bccb7cd84794bc93bc086839e9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.049391 1090 tablet_service.cc:1505] Processing CreateTablet for tablet 7626bccb7cd84794bc93bc086839e9e0 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20251215 20:51:43.050554 1090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7626bccb7cd84794bc93bc086839e9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.053771 1166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7626bccb7cd84794bc93bc086839e9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.027119 1295 raft_consensus.cc:359] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.055349 1295 raft_consensus.cc:385] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.055642 1295 raft_consensus.cc:740] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.061667 1295 consensus_queue.cc:260] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.063643 1094 tablet_service.cc:1505] Processing CreateTablet for tablet 27bef83ec02a48d9ba52b0415116b690 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20251215 20:51:43.064862 1094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bef83ec02a48d9ba52b0415116b690. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.065306 1294 tablet_bootstrap.cc:654] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.076506 1243 tablet_service.cc:1505] Processing CreateTablet for tablet 27bef83ec02a48d9ba52b0415116b690 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20251215 20:51:43.077667 1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bef83ec02a48d9ba52b0415116b690. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.077760 1091 tablet_service.cc:1505] Processing CreateTablet for tablet 1bfebda75f964b3d8c8d47dc1a23b6ae (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20251215 20:51:43.079018 1091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bfebda75f964b3d8c8d47dc1a23b6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.091964 1169 tablet_service.cc:1505] Processing CreateTablet for tablet 1bfebda75f964b3d8c8d47dc1a23b6ae (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20251215 20:51:43.093132 1169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bfebda75f964b3d8c8d47dc1a23b6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.093474 1240 tablet_service.cc:1505] Processing CreateTablet for tablet 1bfebda75f964b3d8c8d47dc1a23b6ae (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20251215 20:51:43.095773 1240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bfebda75f964b3d8c8d47dc1a23b6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.104403 1278 heartbeater.cc:499] Master 127.0.106.190:40965 was elected leader, sending a full tablet report...
I20251215 20:51:43.108150 1168 tablet_service.cc:1505] Processing CreateTablet for tablet 27bef83ec02a48d9ba52b0415116b690 (DEFAULT_TABLE table=test-workload [id=8c53f65dfa8346b290412d54f7f7ece0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20251215 20:51:43.109400 1294 tablet_bootstrap.cc:492] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.109422 1168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bef83ec02a48d9ba52b0415116b690. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:51:43.109863 1294 ts_tablet_manager.cc:1403] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.104s user 0.012s sys 0.006s
I20251215 20:51:43.112524 1294 raft_consensus.cc:359] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.113216 1294 raft_consensus.cc:385] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.113497 1294 raft_consensus.cc:740] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.114161 1294 consensus_queue.cc:260] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.117298 1295 ts_tablet_manager.cc:1434] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.114s user 0.008s sys 0.001s
I20251215 20:51:43.118168 1295 tablet_bootstrap.cc:492] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.123708 1295 tablet_bootstrap.cc:654] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.125485 1293 tablet_bootstrap.cc:492] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.128638 1293 ts_tablet_manager.cc:1403] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.134s user 0.023s sys 0.037s
I20251215 20:51:43.131076 1293 raft_consensus.cc:359] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.131538 1293 raft_consensus.cc:385] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.131757 1293 raft_consensus.cc:740] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.132378 1294 ts_tablet_manager.cc:1434] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20251215 20:51:43.132303 1293 consensus_queue.cc:260] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.134431 1293 ts_tablet_manager.cc:1434] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:51:43.135938 1293 tablet_bootstrap.cc:492] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:43.141543 1294 tablet_bootstrap.cc:492] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.141650 1293 tablet_bootstrap.cc:654] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.143069 1295 tablet_bootstrap.cc:492] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.144659 1295 ts_tablet_manager.cc:1403] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.005s
I20251215 20:51:43.147115 1295 raft_consensus.cc:359] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.147782 1295 raft_consensus.cc:385] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.148097 1295 raft_consensus.cc:740] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.148820 1295 consensus_queue.cc:260] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.149329 1294 tablet_bootstrap.cc:654] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
W20251215 20:51:43.149571 1130 tablet.cc:2378] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 20:51:43.150049 1293 tablet_bootstrap.cc:492] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.150465 1293 ts_tablet_manager.cc:1403] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.004s
I20251215 20:51:43.151258 1295 ts_tablet_manager.cc:1434] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:51:43.152273 1295 tablet_bootstrap.cc:492] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.152886 1293 raft_consensus.cc:359] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.153546 1293 raft_consensus.cc:385] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.153846 1293 raft_consensus.cc:740] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.154619 1293 consensus_queue.cc:260] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.156802 1293 ts_tablet_manager.cc:1434] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20251215 20:51:43.157684 1293 tablet_bootstrap.cc:492] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:43.158293 1295 tablet_bootstrap.cc:654] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.163456 1293 tablet_bootstrap.cc:654] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.170331 1294 tablet_bootstrap.cc:492] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.170845 1294 ts_tablet_manager.cc:1403] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.012s
I20251215 20:51:43.173418 1294 raft_consensus.cc:359] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.173903 1294 raft_consensus.cc:385] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.174137 1294 raft_consensus.cc:740] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.174734 1294 consensus_queue.cc:260] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.175832 1293 tablet_bootstrap.cc:492] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.176357 1293 ts_tablet_manager.cc:1403] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.007s
I20251215 20:51:43.176785 1294 ts_tablet_manager.cc:1434] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20251215 20:51:43.177749 1294 tablet_bootstrap.cc:492] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.178761 1293 raft_consensus.cc:359] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.179670 1293 raft_consensus.cc:385] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.179994 1293 raft_consensus.cc:740] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.180246 1295 tablet_bootstrap.cc:492] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.180753 1295 ts_tablet_manager.cc:1403] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.029s user 0.028s sys 0.000s
I20251215 20:51:43.180811 1293 consensus_queue.cc:260] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.183264 1295 raft_consensus.cc:359] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.183923 1295 raft_consensus.cc:385] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.184224 1295 raft_consensus.cc:740] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.184953 1293 ts_tablet_manager.cc:1434] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.008s user 0.004s sys 0.001s
I20251215 20:51:43.185315 1294 tablet_bootstrap.cc:654] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.184947 1295 consensus_queue.cc:260] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.186107 1293 tablet_bootstrap.cc:492] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:43.183531 1300 raft_consensus.cc:493] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.189055 1295 ts_tablet_manager.cc:1434] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:51:43.189954 1295 tablet_bootstrap.cc:492] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.187819 1300 raft_consensus.cc:515] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.192457 1293 tablet_bootstrap.cc:654] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.195569 1295 tablet_bootstrap.cc:654] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.202906 1299 raft_consensus.cc:493] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.203378 1299 raft_consensus.cc:515] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.206035 1299 leader_election.cc:290] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.220942 1300 leader_election.cc:290] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.244468 1104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.245366 1104 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.245671 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.246404 1253 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.246879 1143 leader_election.cc:304] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.247886 1299 raft_consensus.cc:2804] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.248270 1299 raft_consensus.cc:493] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.248692 1299 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.256208 1299 raft_consensus.cc:515] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.263294 1293 tablet_bootstrap.cc:492] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.263844 1293 ts_tablet_manager.cc:1403] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.078s user 0.008s sys 0.006s
I20251215 20:51:43.264766 1104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.265396 1104 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.267103 1293 raft_consensus.cc:359] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.270818 1293 raft_consensus.cc:385] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.272089 1295 tablet_bootstrap.cc:492] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.272464 1293 raft_consensus.cc:740] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.272647 1295 ts_tablet_manager.cc:1403] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.083s user 0.033s sys 0.049s
I20251215 20:51:43.273578 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.273685 1293 consensus_queue.cc:260] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.274303 1253 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 0.
I20251215 20:51:43.275574 1316 raft_consensus.cc:493] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.275214 1295 raft_consensus.cc:359] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.276233 1299 leader_election.cc:290] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.276976 1295 raft_consensus.cc:385] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.277282 1295 raft_consensus.cc:740] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.277289 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.277890 1253 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.277956 1295 consensus_queue.cc:260] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.280714 1295 ts_tablet_manager.cc:1434] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20251215 20:51:43.281591 1295 tablet_bootstrap.cc:492] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.284387 1253 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.286031 1142 leader_election.cc:304] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:43.276037 1316 raft_consensus.cc:515] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.286731 1299 raft_consensus.cc:2804] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.287170 1299 raft_consensus.cc:697] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:43.287935 1299 consensus_queue.cc:237] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.289496 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.290091 1253 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.291661 1295 tablet_bootstrap.cc:654] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.292119 1142 leader_election.cc:304] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:43.292796 1299 raft_consensus.cc:2804] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.292898 1294 tablet_bootstrap.cc:492] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.292975 1316 leader_election.cc:290] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.293154 1299 raft_consensus.cc:493] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.293416 1294 ts_tablet_manager.cc:1403] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.116s user 0.040s sys 0.072s
I20251215 20:51:43.295661 1299 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.296180 1294 raft_consensus.cc:359] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.296576 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" is_pre_election: true
I20251215 20:51:43.296936 1294 raft_consensus.cc:385] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.297246 1294 raft_consensus.cc:740] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.298177 1293 ts_tablet_manager.cc:1434] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.034s user 0.003s sys 0.006s
I20251215 20:51:43.297887 1294 consensus_queue.cc:260] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.299207 1293 tablet_bootstrap.cc:492] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:43.301918 1299 raft_consensus.cc:515] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.302312 1294 ts_tablet_manager.cc:1434] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20251215 20:51:43.303346 1294 tablet_bootstrap.cc:492] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.303750 1299 leader_election.cc:290] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.304848 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.305406 1253 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.309428 1294 tablet_bootstrap.cc:654] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.312129 1253 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.316880 1142 leader_election.cc:304] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:43.317611 1299 raft_consensus.cc:2804] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.317785 1293 tablet_bootstrap.cc:654] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.318081 1299 raft_consensus.cc:697] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:43.318876 1299 consensus_queue.cc:237] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.313201 1002 catalog_manager.cc:5654] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 1 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.320575 1294 tablet_bootstrap.cc:492] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.321044 1294 ts_tablet_manager.cc:1403] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.003s
I20251215 20:51:43.321202 1103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.320428 1104 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.321852 1103 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.325582 1103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.326115 1103 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.328032 1294 raft_consensus.cc:359] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.328751 1294 raft_consensus.cc:385] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.329049 1294 raft_consensus.cc:740] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.329705 1294 consensus_queue.cc:260] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.331990 1294 ts_tablet_manager.cc:1434] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20251215 20:51:43.332932 1294 tablet_bootstrap.cc:492] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.333382 1067 leader_election.cc:304] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters: 0b0f6771bbfe49378dbacc87a7929b6c
I20251215 20:51:43.334673 1300 raft_consensus.cc:2764] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 20:51:43.332893 1103 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.339157 1294 tablet_bootstrap.cc:654] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.340821 1293 tablet_bootstrap.cc:492] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.341734 1293 ts_tablet_manager.cc:1403] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.043s user 0.010s sys 0.012s
I20251215 20:51:43.342311 1295 tablet_bootstrap.cc:492] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.342777 1295 ts_tablet_manager.cc:1403] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.024s
I20251215 20:51:43.344410 1293 raft_consensus.cc:359] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.345118 1293 raft_consensus.cc:385] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.345409 1293 raft_consensus.cc:740] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.345481 1002 catalog_manager.cc:5654] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 1 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.346266 1294 tablet_bootstrap.cc:492] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.346064 1295 raft_consensus.cc:359] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.346213 1293 consensus_queue.cc:260] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.346784 1295 raft_consensus.cc:385] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.346903 1294 ts_tablet_manager.cc:1403] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20251215 20:51:43.347101 1295 raft_consensus.cc:740] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.347944 1295 consensus_queue.cc:260] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.348865 1293 ts_tablet_manager.cc:1434] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.007s user 0.002s sys 0.005s
I20251215 20:51:43.349792 1293 tablet_bootstrap.cc:492] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:43.349715 1294 raft_consensus.cc:359] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.350543 1294 raft_consensus.cc:385] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.350871 1294 raft_consensus.cc:740] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.351588 1294 consensus_queue.cc:260] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.350246 1295 ts_tablet_manager.cc:1434] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20251215 20:51:43.353659 1295 tablet_bootstrap.cc:492] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.353832 1294 ts_tablet_manager.cc:1434] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:51:43.354804 1294 tablet_bootstrap.cc:492] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.356380 1293 tablet_bootstrap.cc:654] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.359789 1295 tablet_bootstrap.cc:654] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.360563 1294 tablet_bootstrap.cc:654] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.367533 1293 tablet_bootstrap.cc:492] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.367969 1293 ts_tablet_manager.cc:1403] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.013s
I20251215 20:51:43.369069 1295 tablet_bootstrap.cc:492] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.369505 1295 ts_tablet_manager.cc:1403] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.004s
I20251215 20:51:43.370589 1293 raft_consensus.cc:359] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.371280 1293 raft_consensus.cc:385] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.371572 1293 raft_consensus.cc:740] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.372045 1295 raft_consensus.cc:359] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.372742 1295 raft_consensus.cc:385] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.372371 1293 consensus_queue.cc:260] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.373214 1295 raft_consensus.cc:740] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.373991 1295 consensus_queue.cc:260] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.375181 1302 raft_consensus.cc:493] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.375205 1293 ts_tablet_manager.cc:1434] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251215 20:51:43.375659 1302 raft_consensus.cc:515] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.376432 1293 tablet_bootstrap.cc:492] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:43.377960 1294 tablet_bootstrap.cc:492] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.378391 1294 ts_tablet_manager.cc:1403] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.024s user 0.017s sys 0.003s
I20251215 20:51:43.380702 1302 leader_election.cc:290] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), b633549b36214c989518744dd09d2c8b (127.0.106.129:38593)
I20251215 20:51:43.381915 1294 raft_consensus.cc:359] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.382597 1294 raft_consensus.cc:385] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.382956 1293 tablet_bootstrap.cc:654] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.382884 1294 raft_consensus.cc:740] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.384848 1295 ts_tablet_manager.cc:1434] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20251215 20:51:43.385834 1295 tablet_bootstrap.cc:492] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.384848 1294 consensus_queue.cc:260] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.390712 1294 ts_tablet_manager.cc:1434] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20251215 20:51:43.396747 1295 tablet_bootstrap.cc:654] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.404841 1294 tablet_bootstrap.cc:492] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.416620 1294 tablet_bootstrap.cc:654] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.420917 1293 tablet_bootstrap.cc:492] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.421406 1293 ts_tablet_manager.cc:1403] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.045s user 0.027s sys 0.014s
I20251215 20:51:43.423724 1293 raft_consensus.cc:359] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.424057 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272b61c59d214f71b5cfd812120327ca" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" is_pre_election: true
I20251215 20:51:43.424428 1293 raft_consensus.cc:385] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.424736 1293 raft_consensus.cc:740] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.424764 1179 raft_consensus.cc:2468] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 0.
I20251215 20:51:43.425801 1103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272b61c59d214f71b5cfd812120327ca" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.426136 1219 leader_election.cc:304] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:43.426440 1103 raft_consensus.cc:2468] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 0.
I20251215 20:51:43.427023 1302 raft_consensus.cc:2804] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.427386 1302 raft_consensus.cc:493] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.427695 1302 raft_consensus.cc:3060] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.427913 1293 consensus_queue.cc:260] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.432838 1293 ts_tablet_manager.cc:1434] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20251215 20:51:43.433714 1293 tablet_bootstrap.cc:492] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:43.438648 1293 tablet_bootstrap.cc:654] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.435909 1302 raft_consensus.cc:515] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.448626 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272b61c59d214f71b5cfd812120327ca" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:43.449215 1179 raft_consensus.cc:3060] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.449432 1293 tablet_bootstrap.cc:492] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.449863 1293 ts_tablet_manager.cc:1403] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.001s
I20251215 20:51:43.452204 1293 raft_consensus.cc:359] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.452853 1293 raft_consensus.cc:385] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.453120 1293 raft_consensus.cc:740] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.453857 1293 consensus_queue.cc:260] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.456439 1179 raft_consensus.cc:2468] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 1.
I20251215 20:51:43.458338 1293 ts_tablet_manager.cc:1434] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:51:43.459255 1293 tablet_bootstrap.cc:492] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c: Bootstrap starting.
I20251215 20:51:43.465584 1293 tablet_bootstrap.cc:654] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.466064 1302 leader_election.cc:290] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), b633549b36214c989518744dd09d2c8b (127.0.106.129:38593)
I20251215 20:51:43.466246 1103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272b61c59d214f71b5cfd812120327ca" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.467726 1103 raft_consensus.cc:3060] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.466943 1219 leader_election.cc:304] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:43.469429 1302 raft_consensus.cc:2804] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.470058 1302 raft_consensus.cc:697] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Becoming Leader. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:43.469867 1294 tablet_bootstrap.cc:492] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.470755 1294 ts_tablet_manager.cc:1403] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.066s user 0.035s sys 0.013s
I20251215 20:51:43.470711 1327 raft_consensus.cc:493] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.471212 1327 raft_consensus.cc:515] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.473145 1294 raft_consensus.cc:359] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.473737 1294 raft_consensus.cc:385] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.473994 1294 raft_consensus.cc:740] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.474524 1104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.474562 1294 consensus_queue.cc:260] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.476121 1299 raft_consensus.cc:493] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.476579 1299 raft_consensus.cc:515] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.477037 1294 ts_tablet_manager.cc:1434] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20251215 20:51:43.477519 1217 leader_election.cc:343] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b633549b36214c989518744dd09d2c8b (127.0.106.129:38593): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:43.473171 1327 leader_election.cc:290] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:51:43.477957 1294 tablet_bootstrap.cc:492] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.479518 1299 leader_election.cc:290] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.480938 1104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b4cbb73663406b84f800b6ffb7dd79" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.481555 1104 raft_consensus.cc:2468] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
W20251215 20:51:43.482432 1050 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:51:43.482648 1143 leader_election.cc:304] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.483325 1294 tablet_bootstrap.cc:654] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.483457 1299 raft_consensus.cc:2804] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.483817 1299 raft_consensus.cc:493] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.483884 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b4cbb73663406b84f800b6ffb7dd79" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.484218 1299 raft_consensus.cc:3060] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.484484 1103 raft_consensus.cc:2468] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 1.
I20251215 20:51:43.484526 1253 raft_consensus.cc:2468] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.475517 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" is_pre_election: true
I20251215 20:51:43.489230 1179 raft_consensus.cc:2468] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 0.
I20251215 20:51:43.491235 1299 raft_consensus.cc:515] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.490859 1302 consensus_queue.cc:237] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:43.493548 1219 leader_election.cc:304] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters: b633549b36214c989518744dd09d2c8b
I20251215 20:51:43.494336 1327 raft_consensus.cc:2804] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.494658 1327 raft_consensus.cc:493] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.494966 1327 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.498483 1293 tablet_bootstrap.cc:492] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c: No bootstrap required, opened a new log
I20251215 20:51:43.498952 1293 ts_tablet_manager.cc:1403] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.011s
I20251215 20:51:43.499365 1295 tablet_bootstrap.cc:492] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.499805 1295 ts_tablet_manager.cc:1403] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.114s user 0.031s sys 0.047s
I20251215 20:51:43.501477 1293 raft_consensus.cc:359] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.501660 1327 raft_consensus.cc:515] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.502177 1293 raft_consensus.cc:385] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.493901 1103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b4cbb73663406b84f800b6ffb7dd79" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.502578 1317 raft_consensus.cc:493] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.502355 1295 raft_consensus.cc:359] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.503070 1317 raft_consensus.cc:515] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.504679 1104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.504858 1293 raft_consensus.cc:740] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.504985 1317 leader_election.cc:290] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.506003 1300 raft_consensus.cc:493] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.506330 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.506296 1293 consensus_queue.cc:260] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.506894 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.507038 1253 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
W20251215 20:51:43.508237 1217 leader_election.cc:343] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b633549b36214c989518744dd09d2c8b (127.0.106.129:38593): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:43.508545 1293 ts_tablet_manager.cc:1434] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c: Time spent starting tablet: real 0.009s user 0.007s sys 0.001s
I20251215 20:51:43.506434 1300 raft_consensus.cc:515] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.510444 1300 leader_election.cc:290] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.508100 1142 leader_election.cc:304] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:43.511725 1317 raft_consensus.cc:2804] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.511920 1102 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.512075 1317 raft_consensus.cc:493] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.512440 1317 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.513114 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.513634 1253 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 0.
I20251215 20:51:43.514647 1067 leader_election.cc:304] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.518347 1300 raft_consensus.cc:2804] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.518687 1300 raft_consensus.cc:493] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.519006 1300 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.524595 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" is_pre_election: true
I20251215 20:51:43.503050 1295 raft_consensus.cc:385] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.525440 1295 raft_consensus.cc:740] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.525653 1317 raft_consensus.cc:515] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.526134 1295 consensus_queue.cc:260] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.526906 1179 raft_consensus.cc:2393] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b633549b36214c989518744dd09d2c8b in current term 1: Already voted for candidate 0b0f6771bbfe49378dbacc87a7929b6c in this term.
I20251215 20:51:43.528256 1300 raft_consensus.cc:515] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.529904 1300 leader_election.cc:290] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.502660 1103 raft_consensus.cc:3060] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.531702 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.532222 1253 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.536598 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.537278 1102 raft_consensus.cc:2393] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b0f6771bbfe49378dbacc87a7929b6c in current term 1: Already voted for candidate b633549b36214c989518744dd09d2c8b in this term.
I20251215 20:51:43.537760 1252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b4cbb73663406b84f800b6ffb7dd79" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.538324 1252 raft_consensus.cc:3060] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.538700 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:43.539409 1179 raft_consensus.cc:2393] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b633549b36214c989518744dd09d2c8b in current term 1: Already voted for candidate 0b0f6771bbfe49378dbacc87a7929b6c in this term.
I20251215 20:51:43.540928 1299 leader_election.cc:290] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.541728 1327 leader_election.cc:290] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:51:43.542395 1253 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 1.
I20251215 20:51:43.543453 1067 leader_election.cc:304] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters: 0b0f6771bbfe49378dbacc87a7929b6c
I20251215 20:51:43.543987 1252 raft_consensus.cc:2468] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.543736 999 catalog_manager.cc:5654] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131). New cstate: current_term: 1 leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.544763 1317 leader_election.cc:290] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.545284 1142 leader_election.cc:304] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:43.545969 1300 raft_consensus.cc:2804] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.546615 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.546741 1317 raft_consensus.cc:2804] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.547183 1317 raft_consensus.cc:697] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:43.547963 1317 consensus_queue.cc:237] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.548204 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:43.547290 1253 raft_consensus.cc:2393] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b0f6771bbfe49378dbacc87a7929b6c in current term 1: Already voted for candidate b633549b36214c989518744dd09d2c8b in this term.
I20251215 20:51:43.548931 1295 ts_tablet_manager.cc:1434] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.049s user 0.001s sys 0.009s
I20251215 20:51:43.548864 1179 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.550262 1295 tablet_bootstrap.cc:492] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.555189 1179 raft_consensus.cc:2468] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 1.
I20251215 20:51:43.555299 1142 leader_election.cc:304] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c; no voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b
I20251215 20:51:43.536173 1103 raft_consensus.cc:2468] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.556573 1316 raft_consensus.cc:2749] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:51:43.558712 1295 tablet_bootstrap.cc:654] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.559286 1316 raft_consensus.cc:493] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.559695 1316 raft_consensus.cc:515] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.560981 1317 raft_consensus.cc:493] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.561343 1316 leader_election.cc:290] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.561483 1317 raft_consensus.cc:515] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.558506 1219 leader_election.cc:304] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters: b633549b36214c989518744dd09d2c8b
I20251215 20:51:43.563047 1337 raft_consensus.cc:2804] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.563436 1294 tablet_bootstrap.cc:492] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.563817 1294 ts_tablet_manager.cc:1403] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.086s user 0.044s sys 0.017s
I20251215 20:51:43.563671 1337 raft_consensus.cc:697] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Becoming Leader. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:43.563622 1002 catalog_manager.cc:5654] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 1 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.564647 1337 consensus_queue.cc:237] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.564455 1103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.566267 1294 raft_consensus.cc:359] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.566861 1294 raft_consensus.cc:385] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.567119 1294 raft_consensus.cc:740] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.567778 1294 consensus_queue.cc:260] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.568481 1103 raft_consensus.cc:2468] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.569953 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27bef83ec02a48d9ba52b0415116b690" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.571255 1102 raft_consensus.cc:2468] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.572101 1143 leader_election.cc:304] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.573261 1143 leader_election.cc:304] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.573324 1299 raft_consensus.cc:2804] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.573630 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.573827 1299 raft_consensus.cc:493] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.574090 1316 raft_consensus.cc:2804] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.575549 1316 raft_consensus.cc:493] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.576565 1316 raft_consensus.cc:3060] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.574186 1299 raft_consensus.cc:3060] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:51:43.576109 1142 leader_election.cc:343] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:43.584254 1316 raft_consensus.cc:515] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.586598 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27bef83ec02a48d9ba52b0415116b690" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.587338 1294 ts_tablet_manager.cc:1434] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.023s user 0.004s sys 0.009s
I20251215 20:51:43.587235 1253 raft_consensus.cc:2468] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.585804 1317 leader_election.cc:290] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.583487 1002 catalog_manager.cc:5654] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131). New cstate: current_term: 1 leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:43.589258 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27bef83ec02a48d9ba52b0415116b690" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.589766 1102 raft_consensus.cc:3060] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.590387 1295 tablet_bootstrap.cc:492] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.590553 1316 leader_election.cc:290] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.590813 1295 ts_tablet_manager.cc:1403] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.041s user 0.019s sys 0.000s
I20251215 20:51:43.592921 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27bef83ec02a48d9ba52b0415116b690" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.593317 1253 raft_consensus.cc:3060] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.593379 1295 raft_consensus.cc:359] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.594025 1295 raft_consensus.cc:385] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.594288 1295 raft_consensus.cc:740] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.594895 1295 consensus_queue.cc:260] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.596374 1102 raft_consensus.cc:2468] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.596889 1295 ts_tablet_manager.cc:1434] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251215 20:51:43.597496 1143 leader_election.cc:304] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.597913 1253 raft_consensus.cc:2468] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.597733 1295 tablet_bootstrap.cc:492] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.598380 1294 tablet_bootstrap.cc:492] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b: Bootstrap starting.
I20251215 20:51:43.598366 1316 raft_consensus.cc:2804] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.599084 1316 raft_consensus.cc:697] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:43.599633 1300 raft_consensus.cc:697] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:43.599886 1316 consensus_queue.cc:237] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.600518 1300 consensus_queue.cc:237] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.609464 1295 tablet_bootstrap.cc:654] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.609848 1299 raft_consensus.cc:515] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.611995 1294 tablet_bootstrap.cc:654] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.612834 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.612879 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.613627 1102 raft_consensus.cc:3060] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:51:43.614094 1142 leader_election.cc:343] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:51:43.617457 1294 tablet_bootstrap.cc:492] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b: No bootstrap required, opened a new log
I20251215 20:51:43.617875 1294 ts_tablet_manager.cc:1403] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.001s
I20251215 20:51:43.620213 1102 raft_consensus.cc:2468] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.620184 1294 raft_consensus.cc:359] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.620885 1294 raft_consensus.cc:385] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.621167 1294 raft_consensus.cc:740] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.621348 1143 leader_election.cc:304] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters: 8f4a8283586242e8a2f9a2ff10a47cdc
I20251215 20:51:43.621762 1294 consensus_queue.cc:260] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.622191 1317 raft_consensus.cc:2804] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.623742 1294 ts_tablet_manager.cc:1434] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:51:43.628101 1338 raft_consensus.cc:493] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.628592 1338 raft_consensus.cc:515] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.629117 1299 leader_election.cc:290] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.631523 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1f00f72920e4b7a98ab98da3e85344f" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" is_pre_election: true
I20251215 20:51:43.632122 1179 raft_consensus.cc:2468] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 0.
I20251215 20:51:43.633288 1070 leader_election.cc:304] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.634208 1342 raft_consensus.cc:2804] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.634558 1342 raft_consensus.cc:493] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.634895 1342 raft_consensus.cc:3060] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.638419 1295 tablet_bootstrap.cc:492] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.638851 1295 ts_tablet_manager.cc:1403] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.041s user 0.014s sys 0.010s
I20251215 20:51:43.638628 1002 catalog_manager.cc:5654] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 0 to 1, leader changed from <none> to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 1 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.641302 1295 raft_consensus.cc:359] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.641902 1295 raft_consensus.cc:385] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.642196 1342 raft_consensus.cc:515] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.642171 1295 raft_consensus.cc:740] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.645265 1317 raft_consensus.cc:697] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:43.645084 1295 consensus_queue.cc:260] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.646101 1317 consensus_queue.cc:237] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.647095 1295 ts_tablet_manager.cc:1434] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20251215 20:51:43.647950 1295 tablet_bootstrap.cc:492] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc: Bootstrap starting.
I20251215 20:51:43.648211 999 catalog_manager.cc:5654] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 1 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.645133 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1f00f72920e4b7a98ab98da3e85344f" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:43.649606 1179 raft_consensus.cc:3060] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.656989 1295 tablet_bootstrap.cc:654] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc: Neither blocks nor log segments found. Creating new log.
I20251215 20:51:43.657155 1342 leader_election.cc:290] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.657984 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1f00f72920e4b7a98ab98da3e85344f" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.658393 1338 leader_election.cc:290] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.659657 1252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1f00f72920e4b7a98ab98da3e85344f" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.656002 1179 raft_consensus.cc:2468] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 1.
I20251215 20:51:43.658483 1253 raft_consensus.cc:3060] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.662042 1070 leader_election.cc:304] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.662978 1338 raft_consensus.cc:2804] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.663456 1338 raft_consensus.cc:697] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 1 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:43.664903 1338 consensus_queue.cc:237] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.667305 1253 raft_consensus.cc:2468] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 1.
I20251215 20:51:43.675526 1002 catalog_manager.cc:5654] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 1 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.679261 1295 tablet_bootstrap.cc:492] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc: No bootstrap required, opened a new log
I20251215 20:51:43.679713 1295 ts_tablet_manager.cc:1403] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.012s
I20251215 20:51:43.678934 999 catalog_manager.cc:5654] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 0 to 1, leader changed from <none> to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 1 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.681835 1295 raft_consensus.cc:359] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.682322 1295 raft_consensus.cc:385] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:51:43.682528 1295 raft_consensus.cc:740] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Initialized, Role: FOLLOWER
I20251215 20:51:43.683019 1295 consensus_queue.cc:260] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.684789 1295 ts_tablet_manager.cc:1434] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20251215 20:51:43.690937 1338 raft_consensus.cc:493] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.691275 1338 raft_consensus.cc:515] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.692698 1338 leader_election.cc:290] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.693333 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" is_pre_election: true
I20251215 20:51:43.693563 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.694037 1179 raft_consensus.cc:2393] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b633549b36214c989518744dd09d2c8b in current term 1: Already voted for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in this term.
I20251215 20:51:43.694813 1070 leader_election.cc:304] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b633549b36214c989518744dd09d2c8b; no voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc
I20251215 20:51:43.695389 1338 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.699553 1338 raft_consensus.cc:2749] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:43.745677 1337 raft_consensus.cc:493] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.746078 1337 raft_consensus.cc:515] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.747434 1337 leader_election.cc:290] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:51:43.748181 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.748430 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" is_pre_election: true
I20251215 20:51:43.748816 1102 raft_consensus.cc:2393] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f4a8283586242e8a2f9a2ff10a47cdc in current term 1: Already voted for candidate 0b0f6771bbfe49378dbacc87a7929b6c in this term.
I20251215 20:51:43.749601 1217 leader_election.cc:304] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc; no voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b
I20251215 20:51:43.750159 1337 raft_consensus.cc:3060] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.754359 1337 raft_consensus.cc:2749] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:51:43.775144 1317 consensus_queue.cc:1048] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:43.785810 1299 consensus_queue.cc:1048] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:43.830269 1317 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:43.838937 1317 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:43.839414 1347 raft_consensus.cc:493] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:51:43.839929 1347 raft_consensus.cc:515] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.841830 1347 leader_election.cc:290] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.842926 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bfebda75f964b3d8c8d47dc1a23b6ae" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b" is_pre_election: true
I20251215 20:51:43.843283 1252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bfebda75f964b3d8c8d47dc1a23b6ae" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" is_pre_election: true
I20251215 20:51:43.843545 1102 raft_consensus.cc:2468] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.843847 1252 raft_consensus.cc:2468] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 0.
I20251215 20:51:43.844487 1143 leader_election.cc:304] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.846045 1347 raft_consensus.cc:2804] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:51:43.846424 1347 raft_consensus.cc:493] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:51:43.846753 1347 raft_consensus.cc:3060] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.852710 1347 raft_consensus.cc:515] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.854568 1347 leader_election.cc:290] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:43.855049 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bfebda75f964b3d8c8d47dc1a23b6ae" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:43.855367 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bfebda75f964b3d8c8d47dc1a23b6ae" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:43.855568 1102 raft_consensus.cc:3060] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.855831 1253 raft_consensus.cc:3060] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:51:43.860272 1102 raft_consensus.cc:2468] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.860342 1253 raft_consensus.cc:2468] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 1.
I20251215 20:51:43.861176 1143 leader_election.cc:304] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:43.861728 1347 raft_consensus.cc:2804] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:51:43.862136 1347 raft_consensus.cc:697] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:43.862824 1347 consensus_queue.cc:237] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:43.869118 1002 catalog_manager.cc:5654] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 1 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:43.969128 1347 consensus_queue.cc:1048] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:43.975353 1337 consensus_queue.cc:1048] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:43.979327 1316 consensus_queue.cc:1048] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:43.986197 1337 consensus_queue.cc:1048] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:43.991243 1327 consensus_queue.cc:1048] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.001876 1302 consensus_queue.cc:1048] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.009869 1299 consensus_queue.cc:1048] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.019678 1347 consensus_queue.cc:1048] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.038779 1253 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "272b61c59d214f71b5cfd812120327ca"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
mode: GRACEFUL
new_leader_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:50084
I20251215 20:51:44.039306 1253 raft_consensus.cc:606] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Received request to transfer leadership to TS b633549b36214c989518744dd09d2c8b
I20251215 20:51:44.050601 1178 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
mode: GRACEFUL
new_leader_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:54094
I20251215 20:51:44.051047 1178 raft_consensus.cc:606] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Received request to transfer leadership to TS b633549b36214c989518744dd09d2c8b
I20251215 20:51:44.055089 1178 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
mode: GRACEFUL
new_leader_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:54094
I20251215 20:51:44.055487 1178 raft_consensus.cc:606] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Received request to transfer leadership to TS b633549b36214c989518744dd09d2c8b
I20251215 20:51:44.063676 1253 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
mode: GRACEFUL
new_leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
from {username='slave'} at 127.0.0.1:50084
I20251215 20:51:44.064172 1253 raft_consensus.cc:606] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Received request to transfer leadership to TS 0b0f6771bbfe49378dbacc87a7929b6c
I20251215 20:51:44.075172 1178 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1bfebda75f964b3d8c8d47dc1a23b6ae"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
mode: GRACEFUL
new_leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:54094
I20251215 20:51:44.075628 1178 raft_consensus.cc:606] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Received request to transfer leadership to TS 8f4a8283586242e8a2f9a2ff10a47cdc
I20251215 20:51:44.081923 1338 consensus_queue.cc:1048] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.090757 1300 consensus_queue.cc:1048] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.111599 1347 consensus_queue.cc:1048] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.120545 1317 consensus_queue.cc:1048] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.160154 1300 consensus_queue.cc:1048] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.168977 1300 consensus_queue.cc:1048] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.393383 1317 raft_consensus.cc:993] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c: : Instructing follower b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:44.394024 1299 raft_consensus.cc:1081] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Signalling peer b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:44.396086 1103 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:60448
I20251215 20:51:44.396612 1103 raft_consensus.cc:493] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:44.396886 1103 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.401343 1103 raft_consensus.cc:515] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.402737 1103 leader_election.cc:290] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:44.403334 1178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:44.403688 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:44.403795 1178 raft_consensus.cc:3055] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:44.404084 1178 raft_consensus.cc:740] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:44.404115 1253 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.404716 1178 consensus_queue.cc:260] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.405541 1178 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.408735 1253 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:44.409825 1067 leader_election.cc:304] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:44.410494 1300 raft_consensus.cc:2804] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:44.410529 1178 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:44.411078 1300 raft_consensus.cc:697] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:44.411929 1300 consensus_queue.cc:237] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.414611 1299 raft_consensus.cc:993] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c: : Instructing follower b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:44.414959 1302 raft_consensus.cc:993] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc: : Instructing follower b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:44.415030 1299 raft_consensus.cc:1081] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Signalling peer b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:44.415423 1302 raft_consensus.cc:1081] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Signalling peer b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:44.416630 1103 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:60448
I20251215 20:51:44.416823 1102 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "272b61c59d214f71b5cfd812120327ca"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:60464
I20251215 20:51:44.417160 1103 raft_consensus.cc:493] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:44.417296 1102 raft_consensus.cc:493] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:44.417532 1103 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.417658 1102 raft_consensus.cc:3060] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.419905 999 catalog_manager.cc:5654] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 1 to 2, leader changed from 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130) to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 2 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:44.422394 1103 raft_consensus.cc:515] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.424221 1103 leader_election.cc:290] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:44.425009 1178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:44.425120 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:44.425694 1178 raft_consensus.cc:3055] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:44.424170 1102 raft_consensus.cc:515] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:44.425738 1253 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.426175 1178 raft_consensus.cc:740] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:44.426934 1178 consensus_queue.cc:260] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.428157 1178 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.429834 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272b61c59d214f71b5cfd812120327ca" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:44.430089 1252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272b61c59d214f71b5cfd812120327ca" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:44.430392 1179 raft_consensus.cc:3060] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.430684 1252 raft_consensus.cc:3055] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:44.431002 1252 raft_consensus.cc:740] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:44.431756 1252 consensus_queue.cc:260] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:44.432366 1253 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:44.432907 1252 raft_consensus.cc:3060] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.436587 1067 leader_election.cc:304] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:44.437167 1300 raft_consensus.cc:2804] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:44.437248 1179 raft_consensus.cc:2468] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:44.437642 1300 raft_consensus.cc:697] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:44.438688 1252 raft_consensus.cc:2468] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:44.438433 1300 consensus_queue.cc:237] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.439235 1070 leader_election.cc:304] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:44.439823 1102 leader_election.cc:290] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:44.440152 1338 raft_consensus.cc:2804] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:44.440657 1338 raft_consensus.cc:697] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:44.441469 1338 consensus_queue.cc:237] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } }
I20251215 20:51:44.443751 1178 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:44.447256 999 catalog_manager.cc:5654] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 1 to 2, leader changed from 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130) to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 2 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:44.448370 1317 consensus_queue.cc:1048] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.458021 1376 consensus_queue.cc:1048] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:51:44.460214 999 catalog_manager.cc:5654] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 1 to 2, leader changed from 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131) to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 2 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:44.464638 1317 raft_consensus.cc:993] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c: : Instructing follower 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:51:44.465006 1376 raft_consensus.cc:1081] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Signalling peer 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:51:44.466198 1252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1bfebda75f964b3d8c8d47dc1a23b6ae"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:50062
I20251215 20:51:44.466684 1252 raft_consensus.cc:493] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:44.467011 1252 raft_consensus.cc:3060] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.472357 1252 raft_consensus.cc:515] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.474056 1252 leader_election.cc:290] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 2 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:51:44.475723 1178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bfebda75f964b3d8c8d47dc1a23b6ae" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:44.476244 1178 raft_consensus.cc:3055] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:44.476540 1178 raft_consensus.cc:740] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:44.476691 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bfebda75f964b3d8c8d47dc1a23b6ae" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:44.477229 1102 raft_consensus.cc:3060] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.477147 1178 consensus_queue.cc:260] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.478128 1178 raft_consensus.cc:3060] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.481638 1102 raft_consensus.cc:2468] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 2.
I20251215 20:51:44.482496 1178 raft_consensus.cc:2468] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 2.
I20251215 20:51:44.482643 1217 leader_election.cc:304] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:44.483388 1302 raft_consensus.cc:2804] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:44.483817 1302 raft_consensus.cc:697] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 LEADER]: Becoming Leader. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:44.484572 1302 consensus_queue.cc:237] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.489048 1302 raft_consensus.cc:993] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc: : Instructing follower 0b0f6771bbfe49378dbacc87a7929b6c to start an election
I20251215 20:51:44.489459 1327 raft_consensus.cc:1081] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Signalling peer 0b0f6771bbfe49378dbacc87a7929b6c to start an election
I20251215 20:51:44.490895 1178 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
from {username='slave'} at 127.0.0.1:54078
I20251215 20:51:44.491436 1178 raft_consensus.cc:493] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:44.491721 1178 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.496109 1002 catalog_manager.cc:5654] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc reported cstate change: term changed from 1 to 2, leader changed from 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130) to 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131). New cstate: current_term: 2 leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:44.496686 1178 raft_consensus.cc:515] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.499110 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:44.499619 1102 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.500602 1178 leader_election.cc:290] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 2 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:44.501552 1252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:44.502018 1252 raft_consensus.cc:3055] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:44.502269 1252 raft_consensus.cc:740] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:44.502952 1252 consensus_queue.cc:260] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.504063 1252 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:44.504715 1102 raft_consensus.cc:2468] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 2.
I20251215 20:51:44.505605 1143 leader_election.cc:304] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:44.506184 1376 raft_consensus.cc:2804] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:44.506536 1376 raft_consensus.cc:697] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:44.507145 1376 consensus_queue.cc:237] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:44.508657 1252 raft_consensus.cc:2468] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 2.
I20251215 20:51:44.512548 1002 catalog_manager.cc:5654] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 1 to 2, leader changed from 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131) to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 2 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:44.819903 1178 raft_consensus.cc:1275] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:44.820911 1300 consensus_queue.cc:1048] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:44.830382 1252 raft_consensus.cc:1275] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:44.831727 1342 consensus_queue.cc:1048] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:44.903358 1178 raft_consensus.cc:1275] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:44.904470 1342 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:44.911633 1252 raft_consensus.cc:1275] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:44.913651 1338 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:44.944496 1178 raft_consensus.cc:1275] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:44.945420 1338 consensus_queue.cc:1048] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:44.952135 1252 raft_consensus.cc:1275] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:44.953588 1338 consensus_queue.cc:1048] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:44.964686 1178 raft_consensus.cc:1275] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:44.965667 1327 consensus_queue.cc:1048] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:44.971887 1102 raft_consensus.cc:1275] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:44.973135 1337 consensus_queue.cc:1048] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:45.059523 1102 raft_consensus.cc:1275] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Refusing update from remote peer 0b0f6771bbfe49378dbacc87a7929b6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:45.060484 1376 consensus_queue.cc:1048] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:45.068689 1252 raft_consensus.cc:1275] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Refusing update from remote peer 0b0f6771bbfe49378dbacc87a7929b6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:45.069983 1376 consensus_queue.cc:1048] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:47.104727 426 auto_leader_rebalancer-test.cc:343] The leader distribution is
I20251215 20:51:47.105357 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:47.119715 1102 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
mode: GRACEFUL
new_leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:60468
I20251215 20:51:47.120158 1102 raft_consensus.cc:606] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Received request to transfer leadership to TS 8f4a8283586242e8a2f9a2ff10a47cdc
I20251215 20:51:47.122208 1102 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
mode: GRACEFUL
new_leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:60468
I20251215 20:51:47.122625 1102 raft_consensus.cc:606] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 LEADER]: Received request to transfer leadership to TS 8f4a8283586242e8a2f9a2ff10a47cdc
I20251215 20:51:47.123459 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251215 20:51:47.123833 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:47.404827 1338 raft_consensus.cc:993] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b: : Instructing follower 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:51:47.405226 1398 raft_consensus.cc:1081] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Signalling peer 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:51:47.406527 1253 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:50070
I20251215 20:51:47.406919 1253 raft_consensus.cc:493] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:47.407148 1253 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:47.411504 1253 raft_consensus.cc:515] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:47.412930 1253 leader_election.cc:290] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 3 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:51:47.413484 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:47.413859 1178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:47.413980 1102 raft_consensus.cc:3055] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:47.414263 1102 raft_consensus.cc:740] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:47.414295 1178 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:47.414844 1102 consensus_queue.cc:260] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:47.415670 1102 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:47.418401 1178 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 3.
I20251215 20:51:47.419282 1219 leader_election.cc:304] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:47.419983 1102 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 3.
I20251215 20:51:47.420029 1392 raft_consensus.cc:2804] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:47.421182 1392 raft_consensus.cc:697] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 LEADER]: Becoming Leader. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:47.421802 1392 consensus_queue.cc:237] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:47.427501 1000 catalog_manager.cc:5654] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc reported cstate change: term changed from 2 to 3, leader changed from b633549b36214c989518744dd09d2c8b (127.0.106.129) to 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131). New cstate: current_term: 3 leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:47.510421 1338 raft_consensus.cc:993] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b: : Instructing follower 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:51:47.510808 1398 raft_consensus.cc:1081] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 LEADER]: Signalling peer 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:51:47.511950 1253 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:50070
I20251215 20:51:47.512389 1253 raft_consensus.cc:493] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:47.512655 1253 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:47.516696 1253 raft_consensus.cc:515] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:47.517992 1253 leader_election.cc:290] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 2 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:51:47.518718 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:51:47.518972 1178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:47.519340 1102 raft_consensus.cc:3055] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:47.519465 1178 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:47.519693 1102 raft_consensus.cc:740] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:47.520431 1102 consensus_queue.cc:260] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:47.521554 1102 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:47.525627 1178 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 2.
I20251215 20:51:47.526805 1219 leader_election.cc:304] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:51:47.527477 1102 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 2.
I20251215 20:51:47.527683 1392 raft_consensus.cc:2804] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:47.528118 1392 raft_consensus.cc:697] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 LEADER]: Becoming Leader. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:47.528882 1392 consensus_queue.cc:237] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:47.535702 1000 catalog_manager.cc:5654] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc reported cstate change: term changed from 1 to 2, leader changed from b633549b36214c989518744dd09d2c8b (127.0.106.129) to 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131). New cstate: current_term: 2 leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20251215 20:51:47.877063 1178 raft_consensus.cc:1275] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:47.878165 1392 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:47.886533 1102 raft_consensus.cc:1275] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:47.887895 1399 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:48.088266 1178 raft_consensus.cc:1275] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:48.089413 1409 consensus_queue.cc:1048] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:48.097071 1103 raft_consensus.cc:1275] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:48.098723 1409 consensus_queue.cc:1048] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:48.124702 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:48.129963 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:48.130357 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:49.131211 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:49.137225 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:49.137655 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:50.138681 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:50.144686 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:50.145112 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:51.146049 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:51.151122 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:51.151546 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:52.152431 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:52.157847 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:52.158252 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:53.159193 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:53.164832 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:53.165246 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:54.166069 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:54.171247 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:54.171780 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:55.172685 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:55.179976 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:55.180506 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:56.181464 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:51:56.187254 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:51:56.187780 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:51:57.215157 426 auto_leader_rebalancer-test.cc:362] The leader distribution is
I20251215 20:51:57.221272 1253 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
mode: GRACEFUL
new_leader_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:50084
I20251215 20:51:57.221870 1253 raft_consensus.cc:606] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 LEADER]: Received request to transfer leadership to TS b633549b36214c989518744dd09d2c8b
I20251215 20:51:57.228410 1253 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
mode: GRACEFUL
new_leader_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:50084
I20251215 20:51:57.228869 1253 raft_consensus.cc:606] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 LEADER]: Received request to transfer leadership to TS b633549b36214c989518744dd09d2c8b
I20251215 20:51:57.235494 1178 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
mode: GRACEFUL
new_leader_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:54094
I20251215 20:51:57.235946 1178 raft_consensus.cc:606] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 LEADER]: Received request to transfer leadership to TS b633549b36214c989518744dd09d2c8b
I20251215 20:51:57.240123 1178 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e8b4cbb73663406b84f800b6ffb7dd79"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
mode: GRACEFUL
new_leader_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:54094
I20251215 20:51:57.240571 1178 raft_consensus.cc:606] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Received request to transfer leadership to TS b633549b36214c989518744dd09d2c8b
I20251215 20:51:57.244609 1178 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
mode: GRACEFUL
new_leader_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:54094
I20251215 20:51:57.245144 1178 raft_consensus.cc:606] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Received request to transfer leadership to TS b633549b36214c989518744dd09d2c8b
I20251215 20:51:57.316542 1416 raft_consensus.cc:993] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c: : Instructing follower b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.317063 1421 raft_consensus.cc:1081] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Signalling peer b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.318473 1103 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:60448
I20251215 20:51:57.318921 1103 raft_consensus.cc:493] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:57.319192 1103 raft_consensus.cc:3060] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:57.324102 1103 raft_consensus.cc:515] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.325582 1103 leader_election.cc:290] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:57.326629 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:57.326545 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7626bccb7cd84794bc93bc086839e9e0" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:57.327240 1179 raft_consensus.cc:3055] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:57.327375 1253 raft_consensus.cc:3060] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:57.327518 1179 raft_consensus.cc:740] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:57.328253 1179 consensus_queue.cc:260] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.329252 1179 raft_consensus.cc:3060] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:57.332029 1253 raft_consensus.cc:2468] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:57.333120 1067 leader_election.cc:304] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:57.333853 1398 raft_consensus.cc:2804] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:57.334169 1179 raft_consensus.cc:2468] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:57.334878 1398 raft_consensus.cc:697] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:57.335930 1398 consensus_queue.cc:237] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.342972 1000 catalog_manager.cc:5654] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 1 to 2, leader changed from 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130) to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 2 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:57.371416 1416 raft_consensus.cc:993] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c: : Instructing follower b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.371802 1421 raft_consensus.cc:1081] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 LEADER]: Signalling peer b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.373164 1103 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:60448
I20251215 20:51:57.373600 1103 raft_consensus.cc:493] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:57.373881 1103 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:57.378001 1103 raft_consensus.cc:515] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.379343 1103 leader_election.cc:290] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 3 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:57.380193 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:57.380329 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:57.380765 1253 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:57.380730 1179 raft_consensus.cc:3055] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:57.381206 1179 raft_consensus.cc:740] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:57.381876 1179 consensus_queue.cc:260] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.382856 1179 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:57.385051 1253 raft_consensus.cc:2468] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 3.
I20251215 20:51:57.385950 1067 leader_election.cc:304] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:57.386659 1398 raft_consensus.cc:2804] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:57.386997 1398 raft_consensus.cc:697] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:57.387259 1179 raft_consensus.cc:2468] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 3.
I20251215 20:51:57.387724 1398 consensus_queue.cc:237] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.394368 1000 catalog_manager.cc:5654] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 2 to 3, leader changed from 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130) to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 3 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:57.431095 1420 raft_consensus.cc:993] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc: : Instructing follower b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.431564 1429 raft_consensus.cc:1081] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 LEADER]: Signalling peer b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.432960 1103 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:60464
I20251215 20:51:57.433367 1103 raft_consensus.cc:493] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:57.433607 1103 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:57.437654 1103 raft_consensus.cc:515] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.439051 1103 leader_election.cc:290] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 3 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:57.439777 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:57.440039 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:57.440421 1179 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:57.440582 1253 raft_consensus.cc:3055] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:51:57.440894 1253 raft_consensus.cc:740] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:57.441612 1253 consensus_queue.cc:260] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.442782 1253 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:51:57.446568 1179 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 3.
I20251215 20:51:57.447767 1070 leader_election.cc:304] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:57.448627 1398 raft_consensus.cc:2804] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:51:57.448944 1253 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 3.
I20251215 20:51:57.449084 1398 raft_consensus.cc:697] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:57.450222 1398 consensus_queue.cc:237] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.456768 1000 catalog_manager.cc:5654] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 2 to 3, leader changed from 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131) to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 3 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:57.520105 1420 raft_consensus.cc:993] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc: : Instructing follower b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.520519 1429 raft_consensus.cc:1081] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 LEADER]: Signalling peer b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.521826 1103 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:60464
I20251215 20:51:57.522251 1103 raft_consensus.cc:493] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:57.522502 1103 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:57.526567 1103 raft_consensus.cc:515] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.527880 1103 leader_election.cc:290] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 4 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:57.528887 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:57.529002 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:57.529351 1179 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:57.529446 1253 raft_consensus.cc:3055] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:51:57.529760 1253 raft_consensus.cc:740] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:51:57.530313 1253 consensus_queue.cc:260] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.531152 1253 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:51:57.533514 1179 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 4.
I20251215 20:51:57.534382 1070 leader_election.cc:304] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:57.535063 1398 raft_consensus.cc:2804] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:51:57.535197 1253 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 4.
I20251215 20:51:57.535501 1398 raft_consensus.cc:697] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 4 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:57.536630 1398 consensus_queue.cc:237] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.543490 1000 catalog_manager.cc:5654] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 3 to 4, leader changed from 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131) to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 4 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:57.734737 1416 raft_consensus.cc:993] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c: : Instructing follower b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.735147 1421 raft_consensus.cc:1081] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Signalling peer b633549b36214c989518744dd09d2c8b to start an election
I20251215 20:51:57.736464 1103 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e8b4cbb73663406b84f800b6ffb7dd79"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
from {username='slave'} at 127.0.0.1:60448
I20251215 20:51:57.736922 1103 raft_consensus.cc:493] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:51:57.737180 1103 raft_consensus.cc:3060] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:57.741276 1103 raft_consensus.cc:515] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.742581 1103 leader_election.cc:290] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Requested vote from peers 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:51:57.743477 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b4cbb73663406b84f800b6ffb7dd79" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:51:57.743523 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b4cbb73663406b84f800b6ffb7dd79" candidate_uuid: "b633549b36214c989518744dd09d2c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:51:57.743959 1179 raft_consensus.cc:3055] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:51:57.744030 1253 raft_consensus.cc:3060] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:57.744253 1179 raft_consensus.cc:740] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:51:57.744925 1179 consensus_queue.cc:260] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.745836 1179 raft_consensus.cc:3060] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:51:57.748196 1253 raft_consensus.cc:2468] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:57.749069 1067 leader_election.cc:304] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4a8283586242e8a2f9a2ff10a47cdc, b633549b36214c989518744dd09d2c8b; no voters:
I20251215 20:51:57.749670 1398 raft_consensus.cc:2804] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:51:57.749994 1398 raft_consensus.cc:697] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Becoming Leader. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:51:57.749948 1179 raft_consensus.cc:2468] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b633549b36214c989518744dd09d2c8b in term 2.
I20251215 20:51:57.750905 1398 consensus_queue.cc:237] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:51:57.756805 1000 catalog_manager.cc:5654] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b reported cstate change: term changed from 1 to 2, leader changed from 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130) to b633549b36214c989518744dd09d2c8b (127.0.106.129). New cstate: current_term: 2 leader_uuid: "b633549b36214c989518744dd09d2c8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:51:57.764034 1253 raft_consensus.cc:1275] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:57.765079 1398 consensus_queue.cc:1048] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:57.774870 1179 raft_consensus.cc:1275] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:57.776758 1422 consensus_queue.cc:1048] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:51:57.858310 1179 raft_consensus.cc:1275] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:57.859364 1398 consensus_queue.cc:1048] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:57.867733 1253 raft_consensus.cc:1275] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:57.869261 1422 consensus_queue.cc:1048] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:58.002313 1253 raft_consensus.cc:1275] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:58.003413 1422 consensus_queue.cc:1048] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:51:58.011691 1179 raft_consensus.cc:1275] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:51:58.014091 1435 consensus_queue.cc:1048] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251215 20:51:58.030939 1253 raft_consensus.cc:1275] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:51:58.031944 1435 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:58.041062 1179 raft_consensus.cc:1275] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:51:58.042625 1422 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:51:58.215406 1179 raft_consensus.cc:1275] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:58.216480 1422 consensus_queue.cc:1048] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:51:58.224869 1253 raft_consensus.cc:1275] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Refusing update from remote peer b633549b36214c989518744dd09d2c8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:51:58.226636 1435 consensus_queue.cc:1048] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:00.280568 426 auto_leader_rebalancer-test.cc:377] The leader distribution is
I20251215 20:52:00.281491 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:00.289049 1103 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
mode: GRACEFUL
new_leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:60468
I20251215 20:52:00.289687 1103 raft_consensus.cc:606] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 4 LEADER]: Received request to transfer leadership to TS 8f4a8283586242e8a2f9a2ff10a47cdc
I20251215 20:52:00.291906 1103 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
mode: GRACEFUL
new_leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
from {username='slave'} at 127.0.0.1:60468
I20251215 20:52:00.292349 1103 raft_consensus.cc:606] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Received request to transfer leadership to TS 0b0f6771bbfe49378dbacc87a7929b6c
I20251215 20:52:00.294162 1103 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
mode: GRACEFUL
new_leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
from {username='slave'} at 127.0.0.1:60468
I20251215 20:52:00.294544 1103 raft_consensus.cc:606] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Received request to transfer leadership to TS 0b0f6771bbfe49378dbacc87a7929b6c
I20251215 20:52:00.296331 1103 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c"
dest_uuid: "b633549b36214c989518744dd09d2c8b"
mode: GRACEFUL
new_leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:60468
I20251215 20:52:00.296700 1103 raft_consensus.cc:606] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Received request to transfer leadership to TS 8f4a8283586242e8a2f9a2ff10a47cdc
I20251215 20:52:00.297483 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20251215 20:52:00.297904 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:52:00.481961 1448 raft_consensus.cc:993] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b: : Instructing follower 0b0f6771bbfe49378dbacc87a7929b6c to start an election
I20251215 20:52:00.482486 1450 raft_consensus.cc:1081] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Signalling peer 0b0f6771bbfe49378dbacc87a7929b6c to start an election
I20251215 20:52:00.483911 1179 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
from {username='slave'} at 127.0.0.1:54070
I20251215 20:52:00.484411 1179 raft_consensus.cc:493] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:52:00.484696 1179 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:00.490334 1179 raft_consensus.cc:515] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.492276 1179 leader_election.cc:290] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 4 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:52:00.493232 1103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:52:00.493357 1252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9d1dea074f74ae399a82af616cb2ad6" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:52:00.493943 1103 raft_consensus.cc:3055] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:00.493986 1252 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:00.494379 1103 raft_consensus.cc:740] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:52:00.495203 1103 consensus_queue.cc:260] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.496517 1103 raft_consensus.cc:3060] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:00.501471 1252 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 4.
I20251215 20:52:00.502789 1142 leader_election.cc:304] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:52:00.503259 1103 raft_consensus.cc:2468] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 4.
I20251215 20:52:00.503496 1421 raft_consensus.cc:2804] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:00.504514 1421 raft_consensus.cc:697] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:52:00.505331 1421 consensus_queue.cc:237] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.511654 1002 catalog_manager.cc:5654] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 3 to 4, leader changed from b633549b36214c989518744dd09d2c8b (127.0.106.129) to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 4 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:00.723371 1448 raft_consensus.cc:993] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b: : Instructing follower 0b0f6771bbfe49378dbacc87a7929b6c to start an election
I20251215 20:52:00.724956 1448 raft_consensus.cc:1081] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Signalling peer 0b0f6771bbfe49378dbacc87a7929b6c to start an election
I20251215 20:52:00.725519 1450 raft_consensus.cc:993] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b: : Instructing follower 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:52:00.725989 1448 raft_consensus.cc:1081] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Signalling peer 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:52:00.729223 1178 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb"
dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
from {username='slave'} at 127.0.0.1:54070
I20251215 20:52:00.729873 1178 raft_consensus.cc:493] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:52:00.730238 1178 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:00.733908 1252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:50070
I20251215 20:52:00.734645 1252 raft_consensus.cc:493] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:52:00.735021 1252 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:00.740031 1178 raft_consensus.cc:515] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.741917 1178 leader_election.cc:290] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 4 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131:38763)
I20251215 20:52:00.742777 1103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:52:00.743054 1253 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "908492abd62648bda6dfff7a8c405dbb" candidate_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
I20251215 20:52:00.743419 1103 raft_consensus.cc:3055] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:00.743666 1253 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:00.743798 1103 raft_consensus.cc:740] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:52:00.744478 1252 raft_consensus.cc:515] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.744592 1103 consensus_queue.cc:260] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.745873 1103 raft_consensus.cc:3060] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:00.747275 1252 leader_election.cc:290] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 3 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:52:00.748116 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:52:00.748682 1102 raft_consensus.cc:3055] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:00.748946 1102 raft_consensus.cc:740] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:52:00.748984 1178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbb1244e90744c94b7bb8fb894e0325c" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:52:00.749611 1178 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:00.749660 1102 consensus_queue.cc:260] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.750898 1102 raft_consensus.cc:3060] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:00.751039 1253 raft_consensus.cc:2468] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 4.
I20251215 20:52:00.752058 1142 leader_election.cc:304] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:52:00.752149 1103 raft_consensus.cc:2468] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b0f6771bbfe49378dbacc87a7929b6c in term 4.
I20251215 20:52:00.752897 1421 raft_consensus.cc:2804] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:00.753358 1421 raft_consensus.cc:697] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 LEADER]: Becoming Leader. State: Replica: 0b0f6771bbfe49378dbacc87a7929b6c, State: Running, Role: LEADER
I20251215 20:52:00.754179 1421 consensus_queue.cc:237] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.755790 1178 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 3.
I20251215 20:52:00.757184 1102 raft_consensus.cc:2468] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 3.
I20251215 20:52:00.757697 1219 leader_election.cc:304] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:52:00.758656 1429 raft_consensus.cc:2804] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:00.759913 1429 raft_consensus.cc:697] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 LEADER]: Becoming Leader. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:52:00.761574 1429 consensus_queue.cc:237] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.763626 1002 catalog_manager.cc:5654] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c reported cstate change: term changed from 3 to 4, leader changed from b633549b36214c989518744dd09d2c8b (127.0.106.129) to 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130). New cstate: current_term: 4 leader_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:00.768460 1000 catalog_manager.cc:5654] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc reported cstate change: term changed from 2 to 3, leader changed from b633549b36214c989518744dd09d2c8b (127.0.106.129) to 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131). New cstate: current_term: 3 leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:00.804821 1459 raft_consensus.cc:993] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b: : Instructing follower 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:52:00.805320 1458 raft_consensus.cc:1081] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 4 LEADER]: Signalling peer 8f4a8283586242e8a2f9a2ff10a47cdc to start an election
I20251215 20:52:00.806558 1253 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59"
dest_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc"
from {username='slave'} at 127.0.0.1:50070
I20251215 20:52:00.806964 1253 raft_consensus.cc:493] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:52:00.807219 1253 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:00.811200 1253 raft_consensus.cc:515] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.812608 1253 leader_election.cc:290] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 5 election: Requested vote from peers b633549b36214c989518744dd09d2c8b (127.0.106.129:38593), 0b0f6771bbfe49378dbacc87a7929b6c (127.0.106.130:36583)
I20251215 20:52:00.813424 1102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b633549b36214c989518744dd09d2c8b"
I20251215 20:52:00.813570 1179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "818bc67b2c0b45549472e4c9b8de6e59" candidate_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0b0f6771bbfe49378dbacc87a7929b6c"
I20251215 20:52:00.813898 1102 raft_consensus.cc:3055] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 4 LEADER]: Stepping down as leader of term 4
I20251215 20:52:00.814042 1179 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:00.814211 1102 raft_consensus.cc:740] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b633549b36214c989518744dd09d2c8b, State: Running, Role: LEADER
I20251215 20:52:00.814839 1102 consensus_queue.cc:260] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.815765 1102 raft_consensus.cc:3060] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:00.818243 1179 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 5.
I20251215 20:52:00.819125 1219 leader_election.cc:304] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0f6771bbfe49378dbacc87a7929b6c, 8f4a8283586242e8a2f9a2ff10a47cdc; no voters:
I20251215 20:52:00.819797 1102 raft_consensus.cc:2468] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4a8283586242e8a2f9a2ff10a47cdc in term 5.
I20251215 20:52:00.819797 1429 raft_consensus.cc:2804] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:00.820544 1429 raft_consensus.cc:697] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 5 LEADER]: Becoming Leader. State: Replica: 8f4a8283586242e8a2f9a2ff10a47cdc, State: Running, Role: LEADER
I20251215 20:52:00.821466 1429 consensus_queue.cc:237] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } }
I20251215 20:52:00.828104 1000 catalog_manager.cc:5654] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc reported cstate change: term changed from 4 to 5, leader changed from b633549b36214c989518744dd09d2c8b (127.0.106.129) to 8f4a8283586242e8a2f9a2ff10a47cdc (127.0.106.131). New cstate: current_term: 5 leader_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:00.930557 1253 raft_consensus.cc:1275] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Refusing update from remote peer 0b0f6771bbfe49378dbacc87a7929b6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:52:00.931530 1421 consensus_queue.cc:1048] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:00.943454 1102 raft_consensus.cc:1275] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Refusing update from remote peer 0b0f6771bbfe49378dbacc87a7929b6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:52:00.944542 1467 consensus_queue.cc:1048] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:01.185498 1102 raft_consensus.cc:1275] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Refusing update from remote peer 0b0f6771bbfe49378dbacc87a7929b6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:52:01.186647 1467 consensus_queue.cc:1048] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:01.194216 1253 raft_consensus.cc:1275] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Refusing update from remote peer 0b0f6771bbfe49378dbacc87a7929b6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:52:01.195336 1451 consensus_queue.cc:1048] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4a8283586242e8a2f9a2ff10a47cdc" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251215 20:52:01.257807 1179 raft_consensus.cc:1275] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:52:01.258816 1429 consensus_queue.cc:1048] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:01.266716 1102 raft_consensus.cc:1275] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:52:01.268350 1473 consensus_queue.cc:1048] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:01.298835 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:01.305207 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:01.305629 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:52:01.381449 1102 raft_consensus.cc:1275] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 5 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20251215 20:52:01.382560 1473 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b633549b36214c989518744dd09d2c8b" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:01.389981 1179 raft_consensus.cc:1275] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 5 FOLLOWER]: Refusing update from remote peer 8f4a8283586242e8a2f9a2ff10a47cdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20251215 20:52:01.391357 1473 consensus_queue.cc:1048] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0f6771bbfe49378dbacc87a7929b6c" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:02.306452 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:02.311605 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:02.312031 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:52:03.733657 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:03.738832 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:03.739240 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251215 20:52:04.117697 1125 debug-util.cc:398] Leaking SignalData structure 0x7b08001ccf00 after lost signal to thread 429
W20251215 20:52:04.118775 1125 debug-util.cc:398] Leaking SignalData structure 0x7b08000ccba0 after lost signal to thread 1036
W20251215 20:52:04.119848 1125 debug-util.cc:398] Leaking SignalData structure 0x7b0800094980 after lost signal to thread 1128
W20251215 20:52:04.126157 1125 debug-util.cc:398] Leaking SignalData structure 0x7b080012e8c0 after lost signal to thread 1203
W20251215 20:52:04.127518 1125 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8080 after lost signal to thread 1277
I20251215 20:52:04.752868 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:04.962913 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:04.963356 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251215 20:52:05.923688 1033 debug-util.cc:398] Leaking SignalData structure 0x7b0800052fe0 after lost signal to thread 429
W20251215 20:52:05.924464 1033 debug-util.cc:398] Leaking SignalData structure 0x7b080004d6c0 after lost signal to thread 1036
W20251215 20:52:05.925348 1033 debug-util.cc:398] Leaking SignalData structure 0x7b080008c6a0 after lost signal to thread 1128
W20251215 20:52:05.926090 1033 debug-util.cc:398] Leaking SignalData structure 0x7b08001edb80 after lost signal to thread 1203
W20251215 20:52:05.926765 1033 debug-util.cc:398] Leaking SignalData structure 0x7b080010cb60 after lost signal to thread 1277
I20251215 20:52:05.964246 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:05.972195 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:05.972738 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:52:06.973814 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:06.981904 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:06.982492 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:52:07.983533 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:07.991930 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:07.992487 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251215 20:52:09.386068 1033 debug-util.cc:398] Leaking SignalData structure 0x7b08001998a0 after lost signal to thread 429
W20251215 20:52:09.386704 1033 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5d80 after lost signal to thread 1036
W20251215 20:52:09.387436 1033 debug-util.cc:398] Leaking SignalData structure 0x7b080004d0a0 after lost signal to thread 1128
W20251215 20:52:09.388132 1033 debug-util.cc:398] Leaking SignalData structure 0x7b080019a440 after lost signal to thread 1203
W20251215 20:52:09.388767 1033 debug-util.cc:398] Leaking SignalData structure 0x7b08001058e0 after lost signal to thread 1277
I20251215 20:52:09.827721 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:09.833525 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:09.834033 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:52:10.835067 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:10.840473 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:52:10.840973 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:52:11.867621 426 auto_leader_rebalancer-test.cc:388] The leader distribution is
I20251215 20:52:11.868091 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
I20251215 20:52:11.890702 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:52:11.891386 426 tablet_replica.cc:333] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.892037 426 raft_consensus.cc:2243] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:11.892843 426 raft_consensus.cc:2272] T 1bfebda75f964b3d8c8d47dc1a23b6ae P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.895900 426 tablet_replica.cc:333] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.896472 426 raft_consensus.cc:2243] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:11.896922 426 raft_consensus.cc:2272] T 908492abd62648bda6dfff7a8c405dbb P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.898782 426 tablet_replica.cc:333] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.899256 426 raft_consensus.cc:2243] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:11.899601 426 raft_consensus.cc:2272] T 27bef83ec02a48d9ba52b0415116b690 P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.901295 426 tablet_replica.cc:333] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.901901 426 raft_consensus.cc:2243] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:52:11.902829 426 raft_consensus.cc:2272] T b1f00f72920e4b7a98ab98da3e85344f P b633549b36214c989518744dd09d2c8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.904443 426 tablet_replica.cc:333] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.904906 426 raft_consensus.cc:2243] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:52:11.905581 426 raft_consensus.cc:2272] T e8b4cbb73663406b84f800b6ffb7dd79 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.907186 426 tablet_replica.cc:333] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.907665 426 raft_consensus.cc:2243] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:11.908051 426 raft_consensus.cc:2272] T 818bc67b2c0b45549472e4c9b8de6e59 P b633549b36214c989518744dd09d2c8b [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.909631 426 tablet_replica.cc:333] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.910076 426 raft_consensus.cc:2243] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:11.910413 426 raft_consensus.cc:2272] T d9d1dea074f74ae399a82af616cb2ad6 P b633549b36214c989518744dd09d2c8b [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.911913 426 tablet_replica.cc:333] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.912408 426 raft_consensus.cc:2243] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:52:11.913069 426 raft_consensus.cc:2272] T 272b61c59d214f71b5cfd812120327ca P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.914541 426 tablet_replica.cc:333] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.914938 426 raft_consensus.cc:2243] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:52:11.915599 426 raft_consensus.cc:2272] T 7626bccb7cd84794bc93bc086839e9e0 P b633549b36214c989518744dd09d2c8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:11.917176 426 tablet_replica.cc:333] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b: stopping tablet replica
I20251215 20:52:11.917541 426 raft_consensus.cc:2243] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:11.917877 426 raft_consensus.cc:2272] T dbb1244e90744c94b7bb8fb894e0325c P b633549b36214c989518744dd09d2c8b [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:11.922432 1217 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20251215 20:52:11.925580 1217 consensus_peers.cc:597] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc -> Peer b633549b36214c989518744dd09d2c8b (127.0.106.129:38593): Couldn't send request to peer b633549b36214c989518744dd09d2c8b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:11.962471 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
I20251215 20:52:11.981443 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20251215 20:52:11.993664 1143 consensus_peers.cc:597] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c -> Peer b633549b36214c989518744dd09d2c8b (127.0.106.129:38593): Couldn't send request to peer b633549b36214c989518744dd09d2c8b. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:12.007443 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:52:12.008093 426 tablet_replica.cc:333] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.008683 426 raft_consensus.cc:2243] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.009145 426 raft_consensus.cc:2272] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.011066 426 tablet_replica.cc:333] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.011547 426 raft_consensus.cc:2243] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:52:12.012323 426 raft_consensus.cc:2272] T 27bef83ec02a48d9ba52b0415116b690 P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.013954 426 tablet_replica.cc:333] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.014436 426 raft_consensus.cc:2243] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.014838 426 raft_consensus.cc:2272] T e8b4cbb73663406b84f800b6ffb7dd79 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.016465 426 tablet_replica.cc:333] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.016923 426 raft_consensus.cc:2243] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:12.017678 426 raft_consensus.cc:2272] T 908492abd62648bda6dfff7a8c405dbb P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.019205 426 tablet_replica.cc:333] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.019639 426 raft_consensus.cc:2243] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.019992 426 raft_consensus.cc:2272] T b1f00f72920e4b7a98ab98da3e85344f P 0b0f6771bbfe49378dbacc87a7929b6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.021616 426 tablet_replica.cc:333] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.022060 426 raft_consensus.cc:2243] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.022471 426 raft_consensus.cc:2272] T 818bc67b2c0b45549472e4c9b8de6e59 P 0b0f6771bbfe49378dbacc87a7929b6c [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.024063 426 tablet_replica.cc:333] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.024569 426 raft_consensus.cc:2243] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:12.025236 426 raft_consensus.cc:2272] T d9d1dea074f74ae399a82af616cb2ad6 P 0b0f6771bbfe49378dbacc87a7929b6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.026762 426 tablet_replica.cc:333] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.027189 426 raft_consensus.cc:2243] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.027575 426 raft_consensus.cc:2272] T 7626bccb7cd84794bc93bc086839e9e0 P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.029031 426 tablet_replica.cc:333] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.029407 426 raft_consensus.cc:2243] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.029731 426 raft_consensus.cc:2272] T dbb1244e90744c94b7bb8fb894e0325c P 0b0f6771bbfe49378dbacc87a7929b6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.031168 426 tablet_replica.cc:333] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c: stopping tablet replica
I20251215 20:52:12.031520 426 raft_consensus.cc:2243] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.031829 426 raft_consensus.cc:2272] T 272b61c59d214f71b5cfd812120327ca P 0b0f6771bbfe49378dbacc87a7929b6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.058082 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
I20251215 20:52:12.076548 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
I20251215 20:52:12.096810 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:52:12.097393 426 tablet_replica.cc:333] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.097954 426 raft_consensus.cc:2243] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:52:12.098726 426 raft_consensus.cc:2272] T 1bfebda75f964b3d8c8d47dc1a23b6ae P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.100517 426 tablet_replica.cc:333] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.101025 426 raft_consensus.cc:2243] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.101394 426 raft_consensus.cc:2272] T b1f00f72920e4b7a98ab98da3e85344f P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.103084 426 tablet_replica.cc:333] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.103538 426 raft_consensus.cc:2243] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.103925 426 raft_consensus.cc:2272] T 27bef83ec02a48d9ba52b0415116b690 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.105614 426 tablet_replica.cc:333] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.106107 426 raft_consensus.cc:2243] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.106506 426 raft_consensus.cc:2272] T e8b4cbb73663406b84f800b6ffb7dd79 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.108111 426 tablet_replica.cc:333] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.108594 426 raft_consensus.cc:2243] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.108995 426 raft_consensus.cc:2272] T 908492abd62648bda6dfff7a8c405dbb P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.110543 426 tablet_replica.cc:333] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.111025 426 raft_consensus.cc:2243] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:52:12.111737 426 raft_consensus.cc:2272] T 818bc67b2c0b45549472e4c9b8de6e59 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.113420 426 tablet_replica.cc:333] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.113883 426 raft_consensus.cc:2243] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.114286 426 raft_consensus.cc:2272] T d9d1dea074f74ae399a82af616cb2ad6 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.115823 426 tablet_replica.cc:333] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.116278 426 raft_consensus.cc:2243] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.116736 426 raft_consensus.cc:2272] T 7626bccb7cd84794bc93bc086839e9e0 P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.118321 426 tablet_replica.cc:333] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.118727 426 raft_consensus.cc:2243] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:52:12.119374 426 raft_consensus.cc:2272] T dbb1244e90744c94b7bb8fb894e0325c P 8f4a8283586242e8a2f9a2ff10a47cdc [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.120954 426 tablet_replica.cc:333] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc: stopping tablet replica
I20251215 20:52:12.121335 426 raft_consensus.cc:2243] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:12.121718 426 raft_consensus.cc:2272] T 272b61c59d214f71b5cfd812120327ca P 8f4a8283586242e8a2f9a2ff10a47cdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.148509 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20251215 20:52:12.167806 426 master.cc:561] Master@127.0.106.190:40965 shutting down...
I20251215 20:52:12.186646 426 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:52:12.187187 426 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:12.187479 426 tablet_replica.cc:333] T 00000000000000000000000000000000 P 76b1cd0d70cd40f58a49b61b1c601039: stopping tablet replica
I20251215 20:52:12.228096 426 master.cc:583] Master@127.0.106.190:40965 shutdown complete.
0b0f6771bbfe49378dbacc87a7929b6c 4
8f4a8283586242e8a2f9a2ff10a47cdc 1
b633549b36214c989518744dd09d2c8b 5
0b0f6771bbfe49378dbacc87a7929b6c 4
8f4a8283586242e8a2f9a2ff10a47cdc 3
b633549b36214c989518744dd09d2c8b 3
0b0f6771bbfe49378dbacc87a7929b6c 1
8f4a8283586242e8a2f9a2ff10a47cdc 1
b633549b36214c989518744dd09d2c8b 8
0b0f6771bbfe49378dbacc87a7929b6c 3
8f4a8283586242e8a2f9a2ff10a47cdc 3
b633549b36214c989518744dd09d2c8b 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29914 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20251215 20:52:12.267095 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:34859
I20251215 20:52:12.268136 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:52:12.273499 1520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:52:12.273532 1519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:52:12.273993 1522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:52:12.275830 426 server_base.cc:1047] running on GCE node
I20251215 20:52:12.276706 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:52:12.276901 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:52:12.277036 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831932277019 us; error 0 us; skew 500 ppm
I20251215 20:52:12.277513 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:52:12.279680 426 webserver.cc:492] Webserver started at http://127.0.106.190:46181/ using document root <none> and password file <none>
I20251215 20:52:12.280140 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:52:12.280331 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:52:12.280551 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:52:12.281636 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/master-0-root/instance:
uuid: "c49847ab665f4d658c615285f556627e"
format_stamp: "Formatted at 2025-12-15 20:52:12 on dist-test-slave-xp5d"
I20251215 20:52:12.285825 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20251215 20:52:12.288872 1527 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.289530 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251215 20:52:12.289781 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/master-0-root
uuid: "c49847ab665f4d658c615285f556627e"
format_stamp: "Formatted at 2025-12-15 20:52:12 on dist-test-slave-xp5d"
I20251215 20:52:12.290027 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:52:12.311209 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:52:12.312397 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:52:12.347137 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:34859
I20251215 20:52:12.347227 1578 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:34859 every 8 connection(s)
I20251215 20:52:12.350914 1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.360313 1579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e: Bootstrap starting.
I20251215 20:52:12.364688 1579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:12.368454 1579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e: No bootstrap required, opened a new log
I20251215 20:52:12.370404 1579 raft_consensus.cc:359] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c49847ab665f4d658c615285f556627e" member_type: VOTER }
I20251215 20:52:12.370806 1579 raft_consensus.cc:385] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:12.371021 1579 raft_consensus.cc:740] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49847ab665f4d658c615285f556627e, State: Initialized, Role: FOLLOWER
I20251215 20:52:12.371552 1579 consensus_queue.cc:260] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c49847ab665f4d658c615285f556627e" member_type: VOTER }
I20251215 20:52:12.372001 1579 raft_consensus.cc:399] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251215 20:52:12.372208 1579 raft_consensus.cc:493] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251215 20:52:12.372493 1579 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:12.376400 1579 raft_consensus.cc:515] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c49847ab665f4d658c615285f556627e" member_type: VOTER }
I20251215 20:52:12.376865 1579 leader_election.cc:304] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c49847ab665f4d658c615285f556627e; no voters:
I20251215 20:52:12.377894 1579 leader_election.cc:290] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [CANDIDATE]: Term 1 election: Requested vote from peers
I20251215 20:52:12.378180 1582 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:12.379350 1582 raft_consensus.cc:697] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 1 LEADER]: Becoming Leader. State: Replica: c49847ab665f4d658c615285f556627e, State: Running, Role: LEADER
I20251215 20:52:12.379988 1582 consensus_queue.cc:237] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c49847ab665f4d658c615285f556627e" member_type: VOTER }
I20251215 20:52:12.380610 1579 sys_catalog.cc:565] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [sys.catalog]: configured and running, proceeding with master startup.
I20251215 20:52:12.385007 1584 sys_catalog.cc:455] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c49847ab665f4d658c615285f556627e. Latest consensus state: current_term: 1 leader_uuid: "c49847ab665f4d658c615285f556627e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c49847ab665f4d658c615285f556627e" member_type: VOTER } }
I20251215 20:52:12.385303 1583 sys_catalog.cc:455] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c49847ab665f4d658c615285f556627e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c49847ab665f4d658c615285f556627e" member_type: VOTER } }
I20251215 20:52:12.385756 1584 sys_catalog.cc:458] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [sys.catalog]: This master's current role is: LEADER
I20251215 20:52:12.385982 1583 sys_catalog.cc:458] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [sys.catalog]: This master's current role is: LEADER
I20251215 20:52:12.392727 1589 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251215 20:52:12.399287 1589 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251215 20:52:12.400249 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251215 20:52:12.407516 1589 catalog_manager.cc:1357] Generated new cluster ID: 42c1e81c4cdf47a29b093be94d5bdcc8
I20251215 20:52:12.407773 1589 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251215 20:52:12.435434 1589 catalog_manager.cc:1380] Generated new certificate authority record
I20251215 20:52:12.436690 1589 catalog_manager.cc:1514] Loading token signing keys...
I20251215 20:52:12.452518 1589 catalog_manager.cc:6027] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e: Generated new TSK 0
I20251215 20:52:12.453050 1589 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251215 20:52:12.466792 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:52:12.472357 1600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:52:12.473242 1601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:52:12.474838 426 server_base.cc:1047] running on GCE node
W20251215 20:52:12.475175 1603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:52:12.476169 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:52:12.476452 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:52:12.476619 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831932476600 us; error 0 us; skew 500 ppm
I20251215 20:52:12.477125 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:52:12.479245 426 webserver.cc:492] Webserver started at http://127.0.106.129:44005/ using document root <none> and password file <none>
I20251215 20:52:12.479688 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:52:12.479883 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:52:12.480118 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:52:12.481133 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root/instance:
uuid: "9b3367a5854f49b98da54556a209b0de"
format_stamp: "Formatted at 2025-12-15 20:52:12 on dist-test-slave-xp5d"
I20251215 20:52:12.485314 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20251215 20:52:12.488363 1608 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.489015 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251215 20:52:12.489264 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root
uuid: "9b3367a5854f49b98da54556a209b0de"
format_stamp: "Formatted at 2025-12-15 20:52:12 on dist-test-slave-xp5d"
I20251215 20:52:12.489524 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:52:12.502848 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:52:12.504004 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:52:12.505393 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:52:12.507494 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:52:12.507683 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.507902 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:52:12.508050 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.544653 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:38541
I20251215 20:52:12.544736 1670 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:38541 every 8 connection(s)
I20251215 20:52:12.549367 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:52:12.557085 1676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:52:12.557477 1675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:52:12.560191 1678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:52:12.560997 426 server_base.cc:1047] running on GCE node
I20251215 20:52:12.562533 1671 heartbeater.cc:344] Connected to a master server at 127.0.106.190:34859
I20251215 20:52:12.562625 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251215 20:52:12.562848 1671 heartbeater.cc:461] Registering TS with master...
W20251215 20:52:12.562883 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:52:12.563143 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831932563129 us; error 0 us; skew 500 ppm
I20251215 20:52:12.563614 1671 heartbeater.cc:507] Master 127.0.106.190:34859 requested a full tablet report, sending...
I20251215 20:52:12.563663 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:52:12.565677 1544 ts_manager.cc:194] Registered new tserver with Master: 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:12.566211 426 webserver.cc:492] Webserver started at http://127.0.106.130:37665/ using document root <none> and password file <none>
I20251215 20:52:12.566663 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:52:12.566847 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:52:12.567070 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:52:12.567687 1544 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45274
I20251215 20:52:12.568142 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root/instance:
uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
format_stamp: "Formatted at 2025-12-15 20:52:12 on dist-test-slave-xp5d"
I20251215 20:52:12.572685 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20251215 20:52:12.575734 1683 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.576424 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251215 20:52:12.576666 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root
uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
format_stamp: "Formatted at 2025-12-15 20:52:12 on dist-test-slave-xp5d"
I20251215 20:52:12.576907 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:52:12.588104 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:52:12.589210 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:52:12.590539 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:52:12.592799 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:52:12.592983 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.593190 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:52:12.593333 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.629346 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:37421
I20251215 20:52:12.629427 1745 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:37421 every 8 connection(s)
I20251215 20:52:12.633633 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:52:12.640136 1749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:52:12.642397 1750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:52:12.645102 1746 heartbeater.cc:344] Connected to a master server at 127.0.106.190:34859
W20251215 20:52:12.645099 1752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:52:12.645537 1746 heartbeater.cc:461] Registering TS with master...
I20251215 20:52:12.645892 426 server_base.cc:1047] running on GCE node
I20251215 20:52:12.646484 1746 heartbeater.cc:507] Master 127.0.106.190:34859 requested a full tablet report, sending...
I20251215 20:52:12.646811 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:52:12.647045 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:52:12.647222 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831932647205 us; error 0 us; skew 500 ppm
I20251215 20:52:12.647791 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:52:12.648684 1544 ts_manager.cc:194] Registered new tserver with Master: be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:12.650327 426 webserver.cc:492] Webserver started at http://127.0.106.131:42277/ using document root <none> and password file <none>
I20251215 20:52:12.650430 1544 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45280
I20251215 20:52:12.650947 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:52:12.651193 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:52:12.651453 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:52:12.652923 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root/instance:
uuid: "95847161b0414d4e92d6cab94956fa57"
format_stamp: "Formatted at 2025-12-15 20:52:12 on dist-test-slave-xp5d"
I20251215 20:52:12.657076 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20251215 20:52:12.660079 1757 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.660791 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251215 20:52:12.661041 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root
uuid: "95847161b0414d4e92d6cab94956fa57"
format_stamp: "Formatted at 2025-12-15 20:52:12 on dist-test-slave-xp5d"
I20251215 20:52:12.661281 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:52:12.684201 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:52:12.685374 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:52:12.686709 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:52:12.688865 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:52:12.689064 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.689273 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:52:12.689419 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:12.729967 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:45401
I20251215 20:52:12.730052 1819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:45401 every 8 connection(s)
I20251215 20:52:12.741995 1820 heartbeater.cc:344] Connected to a master server at 127.0.106.190:34859
I20251215 20:52:12.742327 1820 heartbeater.cc:461] Registering TS with master...
I20251215 20:52:12.743031 1820 heartbeater.cc:507] Master 127.0.106.190:34859 requested a full tablet report, sending...
I20251215 20:52:12.744796 1544 ts_manager.cc:194] Registered new tserver with Master: 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:12.744886 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.011963032s
I20251215 20:52:12.746125 1544 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45294
I20251215 20:52:12.747016 426 test_util.cc:276] Using random seed: -921330448
I20251215 20:52:12.767983 1544 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45302:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 20:52:12.773833 1544 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 20:52:12.964988 1785 tablet_service.cc:1505] Processing CreateTablet for tablet 2964497f848c4ff98a3846057a1f2528 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251215 20:52:12.966348 1785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964497f848c4ff98a3846057a1f2528. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.966229 1711 tablet_service.cc:1505] Processing CreateTablet for tablet 2964497f848c4ff98a3846057a1f2528 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251215 20:52:12.967489 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964497f848c4ff98a3846057a1f2528. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.969417 1784 tablet_service.cc:1505] Processing CreateTablet for tablet df30f9d71a254842a4b64718482cdeb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251215 20:52:12.970695 1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30f9d71a254842a4b64718482cdeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.972640 1710 tablet_service.cc:1505] Processing CreateTablet for tablet df30f9d71a254842a4b64718482cdeb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251215 20:52:12.973920 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30f9d71a254842a4b64718482cdeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.976984 1709 tablet_service.cc:1505] Processing CreateTablet for tablet 46f5d70a2d6346c498b6686a9f4cb1c9 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251215 20:52:12.978294 1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f5d70a2d6346c498b6686a9f4cb1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.977977 1783 tablet_service.cc:1505] Processing CreateTablet for tablet 46f5d70a2d6346c498b6686a9f4cb1c9 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251215 20:52:12.979205 1783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f5d70a2d6346c498b6686a9f4cb1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.981427 1708 tablet_service.cc:1505] Processing CreateTablet for tablet cbf9f34352854272976701e2b99044e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251215 20:52:12.982688 1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf9f34352854272976701e2b99044e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.983055 1782 tablet_service.cc:1505] Processing CreateTablet for tablet cbf9f34352854272976701e2b99044e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251215 20:52:12.984251 1782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf9f34352854272976701e2b99044e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.989394 1707 tablet_service.cc:1505] Processing CreateTablet for tablet f587ca4384a3442e9dfef8a059e439e8 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251215 20:52:12.989761 1781 tablet_service.cc:1505] Processing CreateTablet for tablet f587ca4384a3442e9dfef8a059e439e8 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251215 20:52:12.990702 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f587ca4384a3442e9dfef8a059e439e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.991007 1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f587ca4384a3442e9dfef8a059e439e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.993924 1780 tablet_service.cc:1505] Processing CreateTablet for tablet 894121edf7014daeaeb0e37428798ef1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251215 20:52:12.995214 1780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894121edf7014daeaeb0e37428798ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:12.997903 1706 tablet_service.cc:1505] Processing CreateTablet for tablet 894121edf7014daeaeb0e37428798ef1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251215 20:52:12.999203 1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894121edf7014daeaeb0e37428798ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.002959 1705 tablet_service.cc:1505] Processing CreateTablet for tablet 15a0578355af497bb35215c17c067b09 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251215 20:52:13.003281 1779 tablet_service.cc:1505] Processing CreateTablet for tablet 15a0578355af497bb35215c17c067b09 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251215 20:52:13.004237 1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a0578355af497bb35215c17c067b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.004576 1779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a0578355af497bb35215c17c067b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.008428 1704 tablet_service.cc:1505] Processing CreateTablet for tablet 037b6406285a4af8bec65f6a1fdfca12 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251215 20:52:13.009727 1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037b6406285a4af8bec65f6a1fdfca12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.009799 1778 tablet_service.cc:1505] Processing CreateTablet for tablet 037b6406285a4af8bec65f6a1fdfca12 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251215 20:52:13.011097 1778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037b6406285a4af8bec65f6a1fdfca12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.013803 1777 tablet_service.cc:1505] Processing CreateTablet for tablet f8fcddff0659452aad4ba12a1187579f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251215 20:52:13.015210 1777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fcddff0659452aad4ba12a1187579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.013805 1703 tablet_service.cc:1505] Processing CreateTablet for tablet f8fcddff0659452aad4ba12a1187579f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251215 20:52:13.015933 1702 tablet_service.cc:1505] Processing CreateTablet for tablet f8b4250dab5b409685b9c36ce1898c9b (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251215 20:52:13.017073 1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fcddff0659452aad4ba12a1187579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.017613 1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b4250dab5b409685b9c36ce1898c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.019345 1776 tablet_service.cc:1505] Processing CreateTablet for tablet f8b4250dab5b409685b9c36ce1898c9b (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251215 20:52:13.021503 1710 tablet_service.cc:1505] Processing CreateTablet for tablet 85dde241a3904afc914c383300a7cf6d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251215 20:52:13.022984 1711 tablet_service.cc:1505] Processing CreateTablet for tablet 86d34bd4c9884678a883bfc6fe5393a8 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251215 20:52:13.024171 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dde241a3904afc914c383300a7cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.028613 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d34bd4c9884678a883bfc6fe5393a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.028640 1776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b4250dab5b409685b9c36ce1898c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.053588 1636 tablet_service.cc:1505] Processing CreateTablet for tablet 2964497f848c4ff98a3846057a1f2528 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251215 20:52:13.054944 1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964497f848c4ff98a3846057a1f2528. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.058178 1635 tablet_service.cc:1505] Processing CreateTablet for tablet df30f9d71a254842a4b64718482cdeb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251215 20:52:13.059504 1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30f9d71a254842a4b64718482cdeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.059671 1710 tablet_service.cc:1505] Processing CreateTablet for tablet f25415c071bc4a8b9f638e653062455a (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251215 20:52:13.061049 1634 tablet_service.cc:1505] Processing CreateTablet for tablet 46f5d70a2d6346c498b6686a9f4cb1c9 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251215 20:52:13.062414 1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f5d70a2d6346c498b6686a9f4cb1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.067286 1633 tablet_service.cc:1505] Processing CreateTablet for tablet cbf9f34352854272976701e2b99044e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251215 20:52:13.069434 1632 tablet_service.cc:1505] Processing CreateTablet for tablet f587ca4384a3442e9dfef8a059e439e8 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251215 20:52:13.071579 1631 tablet_service.cc:1505] Processing CreateTablet for tablet 894121edf7014daeaeb0e37428798ef1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251215 20:52:13.074277 1630 tablet_service.cc:1505] Processing CreateTablet for tablet 15a0578355af497bb35215c17c067b09 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251215 20:52:13.074407 1704 tablet_service.cc:1505] Processing CreateTablet for tablet ae04951b92bc456ab7b716b990df02db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251215 20:52:13.076455 1628 tablet_service.cc:1505] Processing CreateTablet for tablet f8fcddff0659452aad4ba12a1187579f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251215 20:52:13.082170 1629 tablet_service.cc:1505] Processing CreateTablet for tablet 037b6406285a4af8bec65f6a1fdfca12 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251215 20:52:13.083541 1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf9f34352854272976701e2b99044e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.084164 1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f587ca4384a3442e9dfef8a059e439e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.084815 1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a0578355af497bb35215c17c067b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.087041 1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894121edf7014daeaeb0e37428798ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.088199 1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037b6406285a4af8bec65f6a1fdfca12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.102380 1835 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:13.105989 1627 tablet_service.cc:1505] Processing CreateTablet for tablet f8b4250dab5b409685b9c36ce1898c9b (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251215 20:52:13.133040 1785 tablet_service.cc:1505] Processing CreateTablet for tablet ae04951b92bc456ab7b716b990df02db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251215 20:52:13.134755 1785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae04951b92bc456ab7b716b990df02db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.100256 1705 tablet_service.cc:1505] Processing CreateTablet for tablet 8bd979146339464bb689a3bbf6826e47 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251215 20:52:13.137081 1782 tablet_service.cc:1505] Processing CreateTablet for tablet f25415c071bc4a8b9f638e653062455a (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251215 20:52:13.133491 1711 tablet_service.cc:1505] Processing CreateTablet for tablet cd752a241baf44c3aa4fda90213e209f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251215 20:52:13.106642 1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fcddff0659452aad4ba12a1187579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.143738 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25415c071bc4a8b9f638e653062455a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.149739 1781 tablet_service.cc:1505] Processing CreateTablet for tablet 86d34bd4c9884678a883bfc6fe5393a8 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251215 20:52:13.151173 1703 tablet_service.cc:1505] Processing CreateTablet for tablet d45abd42bd074cfeb26d8617e4c3c8b2 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251215 20:52:13.111716 1779 tablet_service.cc:1505] Processing CreateTablet for tablet 85dde241a3904afc914c383300a7cf6d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251215 20:52:13.163621 1635 tablet_service.cc:1505] Processing CreateTablet for tablet 85dde241a3904afc914c383300a7cf6d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251215 20:52:13.164871 1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dde241a3904afc914c383300a7cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.153362 1778 tablet_service.cc:1505] Processing CreateTablet for tablet 0e8905748575496cb493cddc6f527786 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251215 20:52:13.167555 1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae04951b92bc456ab7b716b990df02db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.169353 1632 tablet_service.cc:1505] Processing CreateTablet for tablet 86d34bd4c9884678a883bfc6fe5393a8 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251215 20:52:13.143364 1780 tablet_service.cc:1505] Processing CreateTablet for tablet 8bd979146339464bb689a3bbf6826e47 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251215 20:52:13.153143 1708 tablet_service.cc:1505] Processing CreateTablet for tablet 0e8905748575496cb493cddc6f527786 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251215 20:52:13.169788 1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd979146339464bb689a3bbf6826e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.174494 1777 tablet_service.cc:1505] Processing CreateTablet for tablet 890b2cb838964cd4974f27cd401f1a01 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251215 20:52:13.176891 1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45abd42bd074cfeb26d8617e4c3c8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.176430 1782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25415c071bc4a8b9f638e653062455a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.179526 1779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dde241a3904afc914c383300a7cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.160121 1702 tablet_service.cc:1505] Processing CreateTablet for tablet 247b9d40b010445d97b6159aa1916bf4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251215 20:52:13.179879 1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8905748575496cb493cddc6f527786. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.180459 1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247b9d40b010445d97b6159aa1916bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.180533 1780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd979146339464bb689a3bbf6826e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.180694 1784 tablet_service.cc:1505] Processing CreateTablet for tablet c115c03783ff4ad588081a3566250c5f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251215 20:52:13.183753 1706 tablet_service.cc:1505] Processing CreateTablet for tablet 16211cc39e2742beb0d2ef6ecc0a042b (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251215 20:52:13.184442 1707 tablet_service.cc:1505] Processing CreateTablet for tablet 890b2cb838964cd4974f27cd401f1a01 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251215 20:52:13.153895 1783 tablet_service.cc:1505] Processing CreateTablet for tablet cd752a241baf44c3aa4fda90213e209f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251215 20:52:13.186950 1778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8905748575496cb493cddc6f527786. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.188762 1835 tablet_bootstrap.cc:654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:13.167629 1627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b4250dab5b409685b9c36ce1898c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.189929 1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d34bd4c9884678a883bfc6fe5393a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.190867 1777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890b2cb838964cd4974f27cd401f1a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.192931 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd752a241baf44c3aa4fda90213e209f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.196954 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890b2cb838964cd4974f27cd401f1a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.198431 1636 tablet_service.cc:1505] Processing CreateTablet for tablet f25415c071bc4a8b9f638e653062455a (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251215 20:52:13.200170 1836 tablet_bootstrap.cc:492] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:13.200598 1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c115c03783ff4ad588081a3566250c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.201611 1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16211cc39e2742beb0d2ef6ecc0a042b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.203575 1783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd752a241baf44c3aa4fda90213e209f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.206723 1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d34bd4c9884678a883bfc6fe5393a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.211623 1776 tablet_service.cc:1505] Processing CreateTablet for tablet 16211cc39e2742beb0d2ef6ecc0a042b (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251215 20:52:13.187342 1709 tablet_service.cc:1505] Processing CreateTablet for tablet c115c03783ff4ad588081a3566250c5f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251215 20:52:13.213039 1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c115c03783ff4ad588081a3566250c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.179818 1631 tablet_service.cc:1505] Processing CreateTablet for tablet ae04951b92bc456ab7b716b990df02db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251215 20:52:13.241598 1633 tablet_service.cc:1505] Processing CreateTablet for tablet 8bd979146339464bb689a3bbf6826e47 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251215 20:52:13.250559 1630 tablet_service.cc:1505] Processing CreateTablet for tablet c115c03783ff4ad588081a3566250c5f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251215 20:52:13.258924 1776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16211cc39e2742beb0d2ef6ecc0a042b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.274489 1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25415c071bc4a8b9f638e653062455a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.291692 1778 tablet_service.cc:1505] Processing CreateTablet for tablet 6fb924e2d4664d11b09b8aa8eccab15d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251215 20:52:13.293128 1778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb924e2d4664d11b09b8aa8eccab15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.294193 1710 tablet_service.cc:1505] Processing CreateTablet for tablet 6fb924e2d4664d11b09b8aa8eccab15d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251215 20:52:13.299335 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb924e2d4664d11b09b8aa8eccab15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.309020 1705 tablet_service.cc:1505] Processing CreateTablet for tablet 9f3342ae83724ded89bf01a1e27047be (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251215 20:52:13.345009 1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3342ae83724ded89bf01a1e27047be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.314934 1779 tablet_service.cc:1505] Processing CreateTablet for tablet 2bc2b2e8a3354bd186b3d721581fc8d2 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251215 20:52:13.350274 1779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc2b2e8a3354bd186b3d721581fc8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.321657 1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c115c03783ff4ad588081a3566250c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.330264 1634 tablet_service.cc:1505] Processing CreateTablet for tablet 0e8905748575496cb493cddc6f527786 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251215 20:52:13.352505 1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae04951b92bc456ab7b716b990df02db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.353168 1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8905748575496cb493cddc6f527786. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.354172 1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd979146339464bb689a3bbf6826e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.308893 1704 tablet_service.cc:1505] Processing CreateTablet for tablet 2f9efe5a0bab4fb78f99bca3470e9bb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251215 20:52:13.355176 1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9efe5a0bab4fb78f99bca3470e9bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.329783 1837 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:13.361765 1702 tablet_service.cc:1505] Processing CreateTablet for tablet 2bc2b2e8a3354bd186b3d721581fc8d2 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251215 20:52:13.363162 1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc2b2e8a3354bd186b3d721581fc8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.369589 1835 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:13.370102 1835 ts_tablet_manager.cc:1403] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.268s user 0.007s sys 0.026s
I20251215 20:52:13.373908 1709 tablet_service.cc:1505] Processing CreateTablet for tablet ed49fbba2c19424aa9617a846079bcb3 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251215 20:52:13.375408 1778 tablet_service.cc:1505] Processing CreateTablet for tablet 2f9efe5a0bab4fb78f99bca3470e9bb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251215 20:52:13.377868 1632 tablet_service.cc:1505] Processing CreateTablet for tablet cd752a241baf44c3aa4fda90213e209f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251215 20:52:13.308267 1780 tablet_service.cc:1505] Processing CreateTablet for tablet 9f3342ae83724ded89bf01a1e27047be (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251215 20:52:13.314342 1707 tablet_service.cc:1505] Processing CreateTablet for tablet f226904c96ca4bddbd43673d79635bd7 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20251215 20:52:13.389082 1530 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 48692.7us
I20251215 20:52:13.441529 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f226904c96ca4bddbd43673d79635bd7. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:52:13.392411 1592 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:52:13.395565 1628 tablet_service.cc:1505] Processing CreateTablet for tablet 16211cc39e2742beb0d2ef6ecc0a042b (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251215 20:52:13.396945 1836 tablet_bootstrap.cc:654] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:13.398170 1781 tablet_service.cc:1505] Processing CreateTablet for tablet f226904c96ca4bddbd43673d79635bd7 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251215 20:52:13.401113 1835 raft_consensus.cc:359] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:13.401841 1703 tablet_service.cc:1505] Processing CreateTablet for tablet 3f8f38b230664bc1a6c03587a328cca0 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251215 20:52:13.402679 1837 tablet_bootstrap.cc:654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:13.403119 1708 tablet_service.cc:1505] Processing CreateTablet for tablet dab5221ac7fd4760b078481dd3a91eb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251215 20:52:13.404790 1782 tablet_service.cc:1505] Processing CreateTablet for tablet ed49fbba2c19424aa9617a846079bcb3 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251215 20:52:13.394367 1627 tablet_service.cc:1505] Processing CreateTablet for tablet 890b2cb838964cd4974f27cd401f1a01 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251215 20:52:13.408911 1710 tablet_service.cc:1505] Processing CreateTablet for tablet b6292c3ac4394235a8d94502dcb65913 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251215 20:52:13.413810 1711 tablet_service.cc:1505] Processing CreateTablet for tablet 2f04d2e58d7b495fa12144051af83ae1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251215 20:52:13.404203 1706 tablet_service.cc:1505] Processing CreateTablet for tablet 10e7dc78d083418c9f49bb4450d426f7 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251215 20:52:13.453944 1636 tablet_service.cc:1505] Processing CreateTablet for tablet 2f9efe5a0bab4fb78f99bca3470e9bb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251215 20:52:13.426210 1629 tablet_service.cc:1505] Processing CreateTablet for tablet 6fb924e2d4664d11b09b8aa8eccab15d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251215 20:52:13.432061 1633 tablet_service.cc:1505] Processing CreateTablet for tablet ed49fbba2c19424aa9617a846079bcb3 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251215 20:52:13.439946 1778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9efe5a0bab4fb78f99bca3470e9bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.428901 1634 tablet_service.cc:1505] Processing CreateTablet for tablet 9f3342ae83724ded89bf01a1e27047be (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251215 20:52:13.446971 1835 raft_consensus.cc:385] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:13.458954 1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f226904c96ca4bddbd43673d79635bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.459110 1835 raft_consensus.cc:740] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:13.460347 1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd752a241baf44c3aa4fda90213e209f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.460153 1784 tablet_service.cc:1505] Processing CreateTablet for tablet d45abd42bd074cfeb26d8617e4c3c8b2 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251215 20:52:13.461354 1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45abd42bd074cfeb26d8617e4c3c8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.459964 1835 consensus_queue.cc:260] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:13.462126 1782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed49fbba2c19424aa9617a846079bcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.462568 1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16211cc39e2742beb0d2ef6ecc0a042b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.472867 1627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890b2cb838964cd4974f27cd401f1a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.472981 1780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3342ae83724ded89bf01a1e27047be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.477085 1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9efe5a0bab4fb78f99bca3470e9bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.478173 1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed49fbba2c19424aa9617a846079bcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.484614 1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3342ae83724ded89bf01a1e27047be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.484912 1635 tablet_service.cc:1505] Processing CreateTablet for tablet 2bc2b2e8a3354bd186b3d721581fc8d2 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251215 20:52:13.487303 1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc2b2e8a3354bd186b3d721581fc8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.502787 1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed49fbba2c19424aa9617a846079bcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.503805 1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab5221ac7fd4760b078481dd3a91eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.508605 1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8f38b230664bc1a6c03587a328cca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.508700 1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb924e2d4664d11b09b8aa8eccab15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.503870 1777 tablet_service.cc:1505] Processing CreateTablet for tablet 10e7dc78d083418c9f49bb4450d426f7 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251215 20:52:13.513216 1777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e7dc78d083418c9f49bb4450d426f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.521757 1633 tablet_service.cc:1505] Processing CreateTablet for tablet 247b9d40b010445d97b6159aa1916bf4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251215 20:52:13.523005 1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247b9d40b010445d97b6159aa1916bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.528823 1704 tablet_service.cc:1505] Processing CreateTablet for tablet f3f658260aa8496eab50a8b6eaa515e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251215 20:52:13.511353 1707 tablet_service.cc:1505] Processing CreateTablet for tablet b28e18dcf749433caf5edc863540ec32 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251215 20:52:13.530315 1783 tablet_service.cc:1505] Processing CreateTablet for tablet 247b9d40b010445d97b6159aa1916bf4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251215 20:52:13.531579 1783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247b9d40b010445d97b6159aa1916bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.510190 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f04d2e58d7b495fa12144051af83ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.517401 1630 tablet_service.cc:1505] Processing CreateTablet for tablet f226904c96ca4bddbd43673d79635bd7 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251215 20:52:13.503681 1705 tablet_service.cc:1505] Processing CreateTablet for tablet 5f91c85f57504082af247cc60403edd1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251215 20:52:13.544224 1784 tablet_service.cc:1505] Processing CreateTablet for tablet b6292c3ac4394235a8d94502dcb65913 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251215 20:52:13.544831 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6292c3ac4394235a8d94502dcb65913. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.475575 1776 tablet_service.cc:1505] Processing CreateTablet for tablet 3f8f38b230664bc1a6c03587a328cca0 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251215 20:52:13.545446 1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6292c3ac4394235a8d94502dcb65913. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.546473 1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f658260aa8496eab50a8b6eaa515e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.547212 1778 tablet_service.cc:1505] Processing CreateTablet for tablet f3f658260aa8496eab50a8b6eaa515e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251215 20:52:13.536906 1779 tablet_service.cc:1505] Processing CreateTablet for tablet dab5221ac7fd4760b078481dd3a91eb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251215 20:52:13.551927 1835 ts_tablet_manager.cc:1434] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.182s user 0.015s sys 0.021s
I20251215 20:52:13.554589 1631 tablet_service.cc:1505] Processing CreateTablet for tablet d45abd42bd074cfeb26d8617e4c3c8b2 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251215 20:52:13.558270 1836 tablet_bootstrap.cc:492] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:13.557987 1702 tablet_service.cc:1505] Processing CreateTablet for tablet 59398fb5c6c84abd94ba4b8ee8ad4d6f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251215 20:52:13.559484 1785 tablet_service.cc:1505] Processing CreateTablet for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251215 20:52:13.560871 1776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8f38b230664bc1a6c03587a328cca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.561076 1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f226904c96ca4bddbd43673d79635bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.563066 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28e18dcf749433caf5edc863540ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.565187 1837 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:13.576170 1837 ts_tablet_manager.cc:1403] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.247s user 0.010s sys 0.013s
I20251215 20:52:13.578665 1837 raft_consensus.cc:359] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:13.579326 1837 raft_consensus.cc:385] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:13.579622 1837 raft_consensus.cc:740] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:13.569144 1628 tablet_service.cc:1505] Processing CreateTablet for tablet 3f8f38b230664bc1a6c03587a328cca0 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251215 20:52:13.570094 1671 heartbeater.cc:499] Master 127.0.106.190:34859 was elected leader, sending a full tablet report...
I20251215 20:52:13.575580 1836 ts_tablet_manager.cc:1403] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.376s user 0.014s sys 0.016s
I20251215 20:52:13.584764 1746 heartbeater.cc:499] Master 127.0.106.190:34859 was elected leader, sending a full tablet report...
I20251215 20:52:13.587325 1836 raft_consensus.cc:359] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:13.588008 1836 raft_consensus.cc:385] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:13.588459 1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45abd42bd074cfeb26d8617e4c3c8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.589993 1836 raft_consensus.cc:740] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:13.591297 1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f91c85f57504082af247cc60403edd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.590818 1836 consensus_queue.cc:260] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:13.596704 1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59398fb5c6c84abd94ba4b8ee8ad4d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.596510 1837 consensus_queue.cc:260] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:13.612754 1778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f658260aa8496eab50a8b6eaa515e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.613485 1779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab5221ac7fd4760b078481dd3a91eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.613780 1632 tablet_service.cc:1505] Processing CreateTablet for tablet dab5221ac7fd4760b078481dd3a91eb4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251215 20:52:13.615011 1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab5221ac7fd4760b078481dd3a91eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.616629 1785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.616938 1781 tablet_service.cc:1505] Processing CreateTablet for tablet 2f04d2e58d7b495fa12144051af83ae1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251215 20:52:13.618161 1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f04d2e58d7b495fa12144051af83ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.618036 1708 tablet_service.cc:1505] Processing CreateTablet for tablet 2355bff2629046d8aedcfc2f63a52c18 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251215 20:52:13.625386 1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8f38b230664bc1a6c03587a328cca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.627393 1634 tablet_service.cc:1505] Processing CreateTablet for tablet 10e7dc78d083418c9f49bb4450d426f7 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251215 20:52:13.612668 1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e7dc78d083418c9f49bb4450d426f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.632798 1835 tablet_bootstrap.cc:492] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
W20251215 20:52:13.633478 1747 tablet.cc:2378] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 20:52:13.633287 1633 tablet_service.cc:1505] Processing CreateTablet for tablet b6292c3ac4394235a8d94502dcb65913 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251215 20:52:13.634426 1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6292c3ac4394235a8d94502dcb65913. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.635257 1780 tablet_service.cc:1505] Processing CreateTablet for tablet 5f91c85f57504082af247cc60403edd1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251215 20:52:13.637563 1782 tablet_service.cc:1505] Processing CreateTablet for tablet dcd94ac4984a4f7f855158085913f825 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251215 20:52:13.641615 1627 tablet_service.cc:1505] Processing CreateTablet for tablet f3f658260aa8496eab50a8b6eaa515e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251215 20:52:13.646544 1780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f91c85f57504082af247cc60403edd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.646692 1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2355bff2629046d8aedcfc2f63a52c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.655879 1710 tablet_service.cc:1505] Processing CreateTablet for tablet 4e5d5ba56959418da34e0a6590f4c735 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251215 20:52:13.660799 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5d5ba56959418da34e0a6590f4c735. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.663673 1782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd94ac4984a4f7f855158085913f825. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.667044 1835 tablet_bootstrap.cc:654] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:13.670076 1629 tablet_service.cc:1505] Processing CreateTablet for tablet 2f04d2e58d7b495fa12144051af83ae1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251215 20:52:13.671288 1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e7dc78d083418c9f49bb4450d426f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.671330 1636 tablet_service.cc:1505] Processing CreateTablet for tablet 5f91c85f57504082af247cc60403edd1 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251215 20:52:13.678079 1635 tablet_service.cc:1505] Processing CreateTablet for tablet b28e18dcf749433caf5edc863540ec32 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251215 20:52:13.679569 1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f04d2e58d7b495fa12144051af83ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.647919 1709 tablet_service.cc:1505] Processing CreateTablet for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251215 20:52:13.659523 1703 tablet_service.cc:1505] Processing CreateTablet for tablet dcd94ac4984a4f7f855158085913f825 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251215 20:52:13.696699 1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28e18dcf749433caf5edc863540ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.698125 1837 ts_tablet_manager.cc:1434] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.122s user 0.006s sys 0.008s
I20251215 20:52:13.699160 1837 tablet_bootstrap.cc:492] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:13.700563 1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f91c85f57504082af247cc60403edd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.704864 1820 heartbeater.cc:499] Master 127.0.106.190:34859 was elected leader, sending a full tablet report...
I20251215 20:52:13.706357 1784 tablet_service.cc:1505] Processing CreateTablet for tablet b28e18dcf749433caf5edc863540ec32 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251215 20:52:13.707396 1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd94ac4984a4f7f855158085913f825. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.707566 1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28e18dcf749433caf5edc863540ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.710490 1711 tablet_service.cc:1505] Processing CreateTablet for tablet 810b825e4fe44036ba77841772e5192f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251215 20:52:13.711674 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810b825e4fe44036ba77841772e5192f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.712942 1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.713470 1836 ts_tablet_manager.cc:1434] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.132s user 0.009s sys 0.005s
I20251215 20:52:13.714442 1836 tablet_bootstrap.cc:492] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:13.719153 1704 tablet_service.cc:1505] Processing CreateTablet for tablet 668639c78eab435fb81c2471ddacf0db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251215 20:52:13.725746 1707 tablet_service.cc:1505] Processing CreateTablet for tablet 632ff53f1d7b4cf1a811d346f5e0d6e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251215 20:52:13.728135 1835 tablet_bootstrap.cc:492] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:13.730834 1835 ts_tablet_manager.cc:1403] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.098s user 0.005s sys 0.007s
I20251215 20:52:13.734519 1835 raft_consensus.cc:359] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:13.735190 1835 raft_consensus.cc:385] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:13.735455 1835 raft_consensus.cc:740] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:13.736392 1779 tablet_service.cc:1505] Processing CreateTablet for tablet 668639c78eab435fb81c2471ddacf0db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251215 20:52:13.736654 1630 tablet_service.cc:1505] Processing CreateTablet for tablet 59398fb5c6c84abd94ba4b8ee8ad4d6f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251215 20:52:13.737628 1779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668639c78eab435fb81c2471ddacf0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.739869 1627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f658260aa8496eab50a8b6eaa515e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.739586 1631 tablet_service.cc:1505] Processing CreateTablet for tablet 2355bff2629046d8aedcfc2f63a52c18 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251215 20:52:13.759428 1632 tablet_service.cc:1505] Processing CreateTablet for tablet 810b825e4fe44036ba77841772e5192f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251215 20:52:13.762950 1784 tablet_service.cc:1505] Processing CreateTablet for tablet e26493deab2c43b4ba30189716986767 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251215 20:52:13.764149 1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26493deab2c43b4ba30189716986767. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.764343 1783 tablet_service.cc:1505] Processing CreateTablet for tablet 4e5d5ba56959418da34e0a6590f4c735 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251215 20:52:13.722060 1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668639c78eab435fb81c2471ddacf0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.781095 1783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5d5ba56959418da34e0a6590f4c735. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.747152 1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59398fb5c6c84abd94ba4b8ee8ad4d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.791229 1705 tablet_service.cc:1505] Processing CreateTablet for tablet a434313be259487d9537e911635a6d90 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251215 20:52:13.793710 1636 tablet_service.cc:1505] Processing CreateTablet for tablet 668639c78eab435fb81c2471ddacf0db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251215 20:52:13.794853 1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668639c78eab435fb81c2471ddacf0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.748615 1780 tablet_service.cc:1505] Processing CreateTablet for tablet 810b825e4fe44036ba77841772e5192f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251215 20:52:13.751061 1702 tablet_service.cc:1505] Processing CreateTablet for tablet a7d99999ba4f49a28d840d50bcdcaa16 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251215 20:52:13.748212 1628 tablet_service.cc:1505] Processing CreateTablet for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251215 20:52:13.797312 1836 tablet_bootstrap.cc:654] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:13.797466 1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.753051 1633 tablet_service.cc:1505] Processing CreateTablet for tablet 4e5d5ba56959418da34e0a6590f4c735 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251215 20:52:13.756340 1782 tablet_service.cc:1505] Processing CreateTablet for tablet 632ff53f1d7b4cf1a811d346f5e0d6e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251215 20:52:13.800974 1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5d5ba56959418da34e0a6590f4c735. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.758493 1781 tablet_service.cc:1505] Processing CreateTablet for tablet a7d99999ba4f49a28d840d50bcdcaa16 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251215 20:52:13.801107 1782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632ff53f1d7b4cf1a811d346f5e0d6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.804571 1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d99999ba4f49a28d840d50bcdcaa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.742677 1835 consensus_queue.cc:260] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:13.806423 1835 ts_tablet_manager.cc:1434] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.075s user 0.005s sys 0.000s
I20251215 20:52:13.806746 1703 tablet_service.cc:1505] Processing CreateTablet for tablet 40b5b64d429c4a079403980321090051 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251215 20:52:13.728170 1776 tablet_service.cc:1505] Processing CreateTablet for tablet 2355bff2629046d8aedcfc2f63a52c18 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251215 20:52:13.768661 1842 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:13.808704 1842 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:13.811015 1842 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:13.815027 1780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810b825e4fe44036ba77841772e5192f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.779179 1778 tablet_service.cc:1505] Processing CreateTablet for tablet a434313be259487d9537e911635a6d90 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251215 20:52:13.822256 1778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a434313be259487d9537e911635a6d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.829077 1710 tablet_service.cc:1505] Processing CreateTablet for tablet 113c523599f94be28a277e199067cf22 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251215 20:52:13.829213 1634 tablet_service.cc:1505] Processing CreateTablet for tablet dcd94ac4984a4f7f855158085913f825 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251215 20:52:13.839480 1836 tablet_bootstrap.cc:492] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:13.839987 1836 ts_tablet_manager.cc:1403] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.126s user 0.009s sys 0.001s
I20251215 20:52:13.841118 1776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2355bff2629046d8aedcfc2f63a52c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.842749 1836 raft_consensus.cc:359] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:13.843458 1836 raft_consensus.cc:385] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:13.843743 1836 raft_consensus.cc:740] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:13.844551 1711 tablet_service.cc:1505] Processing CreateTablet for tablet e1388514310d41f78bca30dd0dac6f46 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251215 20:52:13.774190 1777 tablet_service.cc:1505] Processing CreateTablet for tablet 7403a55fe6fa41268e8b54130c9e785d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251215 20:52:13.771903 1708 tablet_service.cc:1505] Processing CreateTablet for tablet 7403a55fe6fa41268e8b54130c9e785d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251215 20:52:13.779220 1784 tablet_service.cc:1505] Processing CreateTablet for tablet 40b5b64d429c4a079403980321090051 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251215 20:52:13.781922 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632ff53f1d7b4cf1a811d346f5e0d6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.856093 1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7403a55fe6fa41268e8b54130c9e785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.856841 1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a434313be259487d9537e911635a6d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.804639 1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810b825e4fe44036ba77841772e5192f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.807332 1835 tablet_bootstrap.cc:492] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:13.767663 1706 tablet_service.cc:1505] Processing CreateTablet for tablet e26493deab2c43b4ba30189716986767 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251215 20:52:13.746343 1785 tablet_service.cc:1505] Processing CreateTablet for tablet 59398fb5c6c84abd94ba4b8ee8ad4d6f (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251215 20:52:13.860565 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113c523599f94be28a277e199067cf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.861105 1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26493deab2c43b4ba30189716986767. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.864312 1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2355bff2629046d8aedcfc2f63a52c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.868585 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1388514310d41f78bca30dd0dac6f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.870694 1835 tablet_bootstrap.cc:654] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:13.872625 1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d99999ba4f49a28d840d50bcdcaa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.875560 1785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59398fb5c6c84abd94ba4b8ee8ad4d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.875918 1633 tablet_service.cc:1505] Processing CreateTablet for tablet a7d99999ba4f49a28d840d50bcdcaa16 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251215 20:52:13.877132 1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d99999ba4f49a28d840d50bcdcaa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.884078 1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b5b64d429c4a079403980321090051. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.888731 1777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7403a55fe6fa41268e8b54130c9e785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.889815 1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b5b64d429c4a079403980321090051. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.766363 1837 tablet_bootstrap.cc:654] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:13.884440 1704 tablet_service.cc:1505] Processing CreateTablet for tablet f78523b75e1f4e8a937902c8178099db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251215 20:52:13.898115 1628 tablet_service.cc:1505] Processing CreateTablet for tablet e26493deab2c43b4ba30189716986767 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251215 20:52:13.898383 1630 tablet_service.cc:1505] Processing CreateTablet for tablet 7403a55fe6fa41268e8b54130c9e785d (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251215 20:52:13.902669 1709 tablet_service.cc:1505] Processing CreateTablet for tablet 9bf291090f874d4ea5be3c23a51eea18 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251215 20:52:13.903909 1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf291090f874d4ea5be3c23a51eea18. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.911787 1836 consensus_queue.cc:260] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:13.915745 1836 ts_tablet_manager.cc:1434] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.075s user 0.005s sys 0.001s
I20251215 20:52:13.916635 1836 tablet_bootstrap.cc:492] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:13.920187 1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd94ac4984a4f7f855158085913f825. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.920878 1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26493deab2c43b4ba30189716986767. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.923336 1836 tablet_bootstrap.cc:654] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:13.924587 1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7403a55fe6fa41268e8b54130c9e785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.930806 1841 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:13.931396 1841 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:13.932776 1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f78523b75e1f4e8a937902c8178099db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.933715 1841 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:13.856046 1629 tablet_service.cc:1505] Processing CreateTablet for tablet 632ff53f1d7b4cf1a811d346f5e0d6e6 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251215 20:52:13.940367 1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632ff53f1d7b4cf1a811d346f5e0d6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.941546 1636 tablet_service.cc:1505] Processing CreateTablet for tablet a434313be259487d9537e911635a6d90 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251215 20:52:13.942852 1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a434313be259487d9537e911635a6d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:13.999226 1835 tablet_bootstrap.cc:492] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:13.999743 1835 ts_tablet_manager.cc:1403] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.193s user 0.008s sys 0.007s
I20251215 20:52:14.002427 1835 raft_consensus.cc:359] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.003121 1835 raft_consensus.cc:385] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.003391 1835 raft_consensus.cc:740] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.006706 1785 tablet_service.cc:1505] Processing CreateTablet for tablet e1388514310d41f78bca30dd0dac6f46 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251215 20:52:14.004015 1835 consensus_queue.cc:260] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.021646 1635 tablet_service.cc:1505] Processing CreateTablet for tablet 40b5b64d429c4a079403980321090051 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251215 20:52:14.033857 1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b5b64d429c4a079403980321090051. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.034579 1835 ts_tablet_manager.cc:1434] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
I20251215 20:52:14.037937 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.038614 1835 tablet_bootstrap.cc:492] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
W20251215 20:52:14.039608 1760 leader_election.cc:343] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.052503 1841 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.056315 1841 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:14.057194 1632 tablet_service.cc:1505] Processing CreateTablet for tablet 113c523599f94be28a277e199067cf22 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251215 20:52:14.058153 1841 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:14.058386 1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113c523599f94be28a277e199067cf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.062412 1843 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.062216 1780 tablet_service.cc:1505] Processing CreateTablet for tablet 113c523599f94be28a277e199067cf22 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251215 20:52:14.062883 1843 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.068410 1843 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.077771 1627 tablet_service.cc:1505] Processing CreateTablet for tablet e1388514310d41f78bca30dd0dac6f46 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251215 20:52:14.079234 1627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1388514310d41f78bca30dd0dac6f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.070209 1785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1388514310d41f78bca30dd0dac6f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.083278 1779 tablet_service.cc:1505] Processing CreateTablet for tablet f78523b75e1f4e8a937902c8178099db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251215 20:52:14.089756 1628 tablet_service.cc:1505] Processing CreateTablet for tablet f78523b75e1f4e8a937902c8178099db (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251215 20:52:14.101248 1835 tablet_bootstrap.cc:654] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.102480 1631 tablet_service.cc:1505] Processing CreateTablet for tablet 9bf291090f874d4ea5be3c23a51eea18 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251215 20:52:14.103518 1837 tablet_bootstrap.cc:492] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.107862 1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f78523b75e1f4e8a937902c8178099db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.108624 1629 tablet_service.cc:1505] Processing CreateTablet for tablet 23db9937c6294006a7fac93aa519bad4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251215 20:52:14.109805 1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23db9937c6294006a7fac93aa519bad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.128885 1837 ts_tablet_manager.cc:1403] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.430s user 0.016s sys 0.035s
I20251215 20:52:14.131054 1780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113c523599f94be28a277e199067cf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.138247 1836 tablet_bootstrap.cc:492] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.138707 1836 ts_tablet_manager.cc:1403] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.222s user 0.007s sys 0.008s
I20251215 20:52:14.140666 1779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f78523b75e1f4e8a937902c8178099db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.142236 1778 tablet_service.cc:1505] Processing CreateTablet for tablet 9bf291090f874d4ea5be3c23a51eea18 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251215 20:52:14.143391 1778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf291090f874d4ea5be3c23a51eea18. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.146281 1705 tablet_service.cc:1505] Processing CreateTablet for tablet cffb60a2970e4e049f29999509c860aa (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251215 20:52:14.147457 1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffb60a2970e4e049f29999509c860aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.133467 1711 tablet_service.cc:1505] Processing CreateTablet for tablet 23db9937c6294006a7fac93aa519bad4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251215 20:52:14.154882 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23db9937c6294006a7fac93aa519bad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.159631 1634 tablet_service.cc:1505] Processing CreateTablet for tablet 0bb86f5c9ae14081b0e0633dacbfcb59 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251215 20:52:14.160569 1702 tablet_service.cc:1505] Processing CreateTablet for tablet 8e5a5566d2334d5f8f6829f319ce32af (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251215 20:52:14.161769 1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5a5566d2334d5f8f6829f319ce32af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.162535 1837 raft_consensus.cc:359] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.163231 1837 raft_consensus.cc:385] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.163503 1837 raft_consensus.cc:740] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.164985 1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf291090f874d4ea5be3c23a51eea18. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.166975 1633 tablet_service.cc:1505] Processing CreateTablet for tablet cffb60a2970e4e049f29999509c860aa (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251215 20:52:14.168107 1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffb60a2970e4e049f29999509c860aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.168486 1710 tablet_service.cc:1505] Processing CreateTablet for tablet 8350524f9e4a49929464adde48de2442 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251215 20:52:14.176563 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8350524f9e4a49929464adde48de2442. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.169035 1703 tablet_service.cc:1505] Processing CreateTablet for tablet 0bb86f5c9ae14081b0e0633dacbfcb59 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251215 20:52:14.169226 1782 tablet_service.cc:1505] Processing CreateTablet for tablet 98273a1b4c27409fbf35f33b10ca80f0 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251215 20:52:14.169488 1783 tablet_service.cc:1505] Processing CreateTablet for tablet 23db9937c6294006a7fac93aa519bad4 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251215 20:52:14.171190 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.171105 1777 tablet_service.cc:1505] Processing CreateTablet for tablet 0bb86f5c9ae14081b0e0633dacbfcb59 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251215 20:52:14.172057 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.174099 1630 tablet_service.cc:1505] Processing CreateTablet for tablet 98273a1b4c27409fbf35f33b10ca80f0 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251215 20:52:14.182127 1635 tablet_service.cc:1505] Processing CreateTablet for tablet 8e5a5566d2334d5f8f6829f319ce32af (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251215 20:52:14.152664 1708 tablet_service.cc:1505] Processing CreateTablet for tablet 98273a1b4c27409fbf35f33b10ca80f0 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251215 20:52:14.184175 1636 tablet_service.cc:1505] Processing CreateTablet for tablet 8350524f9e4a49929464adde48de2442 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251215 20:52:14.192068 1646 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:14.193977 1781 tablet_service.cc:1505] Processing CreateTablet for tablet 8350524f9e4a49929464adde48de2442 (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251215 20:52:14.196461 1784 tablet_service.cc:1505] Processing CreateTablet for tablet 8e5a5566d2334d5f8f6829f319ce32af (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251215 20:52:14.198064 1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98273a1b4c27409fbf35f33b10ca80f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.200887 1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb86f5c9ae14081b0e0633dacbfcb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.204623 1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5a5566d2334d5f8f6829f319ce32af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.206517 1783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23db9937c6294006a7fac93aa519bad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.198011 1686 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.208192 1841 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.208631 1841 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.208964 1841 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:52:14.208280 1686 leader_election.cc:343] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.164151 1837 consensus_queue.cc:260] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.177747 1776 tablet_service.cc:1505] Processing CreateTablet for tablet cffb60a2970e4e049f29999509c860aa (DEFAULT_TABLE table=test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251215 20:52:14.218669 1837 ts_tablet_manager.cc:1434] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.085s user 0.000s sys 0.005s
I20251215 20:52:14.232415 1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb86f5c9ae14081b0e0633dacbfcb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.235894 1777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb86f5c9ae14081b0e0633dacbfcb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.238168 1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98273a1b4c27409fbf35f33b10ca80f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.239043 1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5a5566d2334d5f8f6829f319ce32af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.244781 1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8350524f9e4a49929464adde48de2442. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.246757 1841 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.250002 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:14.250558 1645 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.252563 1836 raft_consensus.cc:359] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.253233 1836 raft_consensus.cc:385] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.253518 1836 raft_consensus.cc:740] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.254186 1836 consensus_queue.cc:260] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.258744 1776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffb60a2970e4e049f29999509c860aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.265570 1782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98273a1b4c27409fbf35f33b10ca80f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.257304 1645 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:14.273487 1686 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.256266 1836 ts_tablet_manager.cc:1434] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.117s user 0.003s sys 0.000s
I20251215 20:52:14.256740 1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8350524f9e4a49929464adde48de2442. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:14.258020 1837 tablet_bootstrap.cc:492] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.284188 1863 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.284685 1863 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.291198 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.291896 1645 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:14.292661 1836 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.293110 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.293889 1721 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:14.305387 1842 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.305853 1842 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.307111 1686 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.307734 1842 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:14.309283 1841 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.310019 1841 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:14.310698 1842 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.311131 1842 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.313110 1842 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:14.286600 1863 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.315618 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:14.317145 1760 leader_election.cc:343] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.318104 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.316987 1863 raft_consensus.cc:2804] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
W20251215 20:52:14.319443 1760 leader_election.cc:343] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.327667 1836 tablet_bootstrap.cc:654] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.310504 1841 raft_consensus.cc:697] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:14.328898 1841 consensus_queue.cc:237] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.319484 1863 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.343542 1837 tablet_bootstrap.cc:654] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.345785 1835 tablet_bootstrap.cc:492] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.346253 1835 ts_tablet_manager.cc:1403] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.308s user 0.025s sys 0.043s
I20251215 20:52:14.347824 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.348258 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.348454 1721 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:14.334610 1863 raft_consensus.cc:3060] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.351099 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.351505 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:14.352922 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 45885.6us
I20251215 20:52:14.354686 1835 raft_consensus.cc:359] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.355428 1835 raft_consensus.cc:385] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.355726 1835 raft_consensus.cc:740] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.356468 1835 consensus_queue.cc:260] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.358788 1835 ts_tablet_manager.cc:1434] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
W20251215 20:52:14.351428 1761 leader_election.cc:343] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.359586 1761 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:14.360391 1842 raft_consensus.cc:2749] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:14.361333 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.361922 1795 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
W20251215 20:52:14.362130 1761 leader_election.cc:343] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.362605 1761 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:14.362989 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.363833 1761 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:14.364194 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:14.367174 1842 raft_consensus.cc:2749] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:14.371924 1842 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.373160 1842 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.374500 1835 tablet_bootstrap.cc:492] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.376603 1842 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.375051 1836 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.379323 1836 ts_tablet_manager.cc:1403] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.087s user 0.009s sys 0.022s
I20251215 20:52:14.376137 1837 tablet_bootstrap.cc:492] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.380223 1837 ts_tablet_manager.cc:1403] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.122s user 0.013s sys 0.014s
I20251215 20:52:14.383657 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.383845 1837 raft_consensus.cc:359] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.384711 1837 raft_consensus.cc:385] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.385054 1837 raft_consensus.cc:740] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
W20251215 20:52:14.385252 1612 leader_election.cc:343] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.385769 1612 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:14.386921 1843 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:14.389657 1544 catalog_manager.cc:5654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:14.385946 1837 consensus_queue.cc:260] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:14.392088 1687 leader_election.cc:343] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.396687 1842 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:14.399055 1842 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:14.400102 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:14.401618 1760 leader_election.cc:343] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.409610 1837 ts_tablet_manager.cc:1434] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.029s user 0.005s sys 0.001s
I20251215 20:52:14.393468 1835 tablet_bootstrap.cc:654] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.416378 1836 raft_consensus.cc:359] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.417174 1836 raft_consensus.cc:385] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.417464 1836 raft_consensus.cc:740] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.418285 1836 consensus_queue.cc:260] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.421128 1837 tablet_bootstrap.cc:492] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.429245 1836 ts_tablet_manager.cc:1434] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.050s user 0.007s sys 0.000s
W20251215 20:52:14.430546 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 66803us
I20251215 20:52:14.433482 1835 tablet_bootstrap.cc:492] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.431475 1687 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:14.434267 1835 ts_tablet_manager.cc:1403] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.060s user 0.012s sys 0.001s
I20251215 20:52:14.434445 1841 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.434827 1841 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.435161 1841 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.436686 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:14.437602 1835 raft_consensus.cc:359] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.438282 1835 raft_consensus.cc:385] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.438550 1835 raft_consensus.cc:740] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.439188 1835 consensus_queue.cc:260] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:14.435115 1687 leader_election.cc:343] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:14.441452 1687 leader_election.cc:343] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.444106 1841 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:14.445475 1721 raft_consensus.cc:2393] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:14.445895 1835 ts_tablet_manager.cc:1434] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.011s user 0.002s sys 0.004s
I20251215 20:52:14.446107 1836 tablet_bootstrap.cc:492] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.446981 1835 tablet_bootstrap.cc:492] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.447871 1761 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:14.449174 1868 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:52:14.449818 1841 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:14.450729 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:14.450938 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:14.451570 1793 raft_consensus.cc:2393] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 1: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
W20251215 20:52:14.452140 1686 leader_election.cc:343] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.452900 1837 tablet_bootstrap.cc:654] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.453395 1835 tablet_bootstrap.cc:654] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.454879 1836 tablet_bootstrap.cc:654] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.442513 1863 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.456539 1687 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:14.457356 1841 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:52:14.461265 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:14.461846 1645 raft_consensus.cc:3060] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:52:14.463182 1592 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:52:14.464864 1836 tablet_bootstrap.cc:492] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.465245 1836 ts_tablet_manager.cc:1403] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.001s
I20251215 20:52:14.468871 1836 raft_consensus.cc:359] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.469179 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:14.471314 1836 raft_consensus.cc:385] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.471465 1837 tablet_bootstrap.cc:492] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.471721 1836 raft_consensus.cc:740] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.469699 1645 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:14.472496 1835 tablet_bootstrap.cc:492] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.472929 1835 ts_tablet_manager.cc:1403] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.008s
I20251215 20:52:14.473063 1686 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.469614 1863 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.473851 1863 raft_consensus.cc:2804] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:14.473352 1836 consensus_queue.cc:260] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.474298 1863 raft_consensus.cc:697] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:14.474453 1793 raft_consensus.cc:3060] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.475097 1863 consensus_queue.cc:237] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.475417 1835 raft_consensus.cc:359] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.476109 1835 raft_consensus.cc:385] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.476416 1835 raft_consensus.cc:740] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.477051 1835 consensus_queue.cc:260] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.479210 1835 ts_tablet_manager.cc:1434] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:14.471936 1837 ts_tablet_manager.cc:1403] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.006s
I20251215 20:52:14.480069 1835 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.480618 1868 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.481043 1868 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.482065 1793 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:14.482633 1837 raft_consensus.cc:359] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.483311 1837 raft_consensus.cc:385] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.483628 1837 raft_consensus.cc:740] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.484361 1837 consensus_queue.cc:260] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.485270 1836 ts_tablet_manager.cc:1434] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20251215 20:52:14.487298 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.488487 1841 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.489032 1836 tablet_bootstrap.cc:492] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.489084 1841 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.491135 1841 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.492452 1835 tablet_bootstrap.cc:654] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:14.488536 1761 leader_election.cc:343] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.494262 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.494601 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.495672 1836 tablet_bootstrap.cc:654] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:14.495839 1686 leader_election.cc:343] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:14.497740 1760 leader_election.cc:343] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.483255 1868 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:14.499923 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:14.501176 1687 leader_election.cc:343] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.501622 1687 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:14.502138 1760 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:14.503229 1868 raft_consensus.cc:2749] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:14.503631 1863 raft_consensus.cc:2749] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:14.504905 1837 ts_tablet_manager.cc:1434] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.025s user 0.003s sys 0.003s
I20251215 20:52:14.505884 1837 tablet_bootstrap.cc:492] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.509831 1544 catalog_manager.cc:5654] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:14.512068 1836 tablet_bootstrap.cc:492] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.512494 1836 ts_tablet_manager.cc:1403] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.008s
I20251215 20:52:14.516033 1837 tablet_bootstrap.cc:654] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.516208 1836 raft_consensus.cc:359] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.516880 1836 raft_consensus.cc:385] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.517127 1836 raft_consensus.cc:740] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.517755 1836 consensus_queue.cc:260] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.521060 1835 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.521509 1836 ts_tablet_manager.cc:1434] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.009s user 0.002s sys 0.004s
I20251215 20:52:14.521507 1835 ts_tablet_manager.cc:1403] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.004s
I20251215 20:52:14.522704 1836 tablet_bootstrap.cc:492] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.524444 1835 raft_consensus.cc:359] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.525097 1835 raft_consensus.cc:385] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.525893 1835 raft_consensus.cc:740] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.526499 1835 consensus_queue.cc:260] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.528741 1837 tablet_bootstrap.cc:492] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.529142 1837 ts_tablet_manager.cc:1403] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.001s
I20251215 20:52:14.530591 1836 tablet_bootstrap.cc:654] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.531524 1837 raft_consensus.cc:359] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:14.532207 1837 raft_consensus.cc:385] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.532502 1837 raft_consensus.cc:740] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.533358 1837 consensus_queue.cc:260] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:14.535061 1835 ts_tablet_manager.cc:1434] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.013s user 0.004s sys 0.002s
I20251215 20:52:14.536322 1836 tablet_bootstrap.cc:492] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.536770 1836 ts_tablet_manager.cc:1403] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20251215 20:52:14.537631 1835 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.539501 1836 raft_consensus.cc:359] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.540225 1836 raft_consensus.cc:385] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.540571 1836 raft_consensus.cc:740] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.541831 1836 consensus_queue.cc:260] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.543736 1835 tablet_bootstrap.cc:654] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.543989 1836 ts_tablet_manager.cc:1434] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251215 20:52:14.536782 1837 ts_tablet_manager.cc:1434] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251215 20:52:14.545204 1837 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.551299 1837 tablet_bootstrap.cc:654] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.563814 1836 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.565503 1835 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.566016 1835 ts_tablet_manager.cc:1403] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.005s
I20251215 20:52:14.568890 1835 raft_consensus.cc:359] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.569098 1836 tablet_bootstrap.cc:654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.569379 1835 raft_consensus.cc:385] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.569694 1835 raft_consensus.cc:740] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.570349 1835 consensus_queue.cc:260] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.571291 1837 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.571730 1837 ts_tablet_manager.cc:1403] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.014s
I20251215 20:52:14.572439 1835 ts_tablet_manager.cc:1434] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251215 20:52:14.573482 1835 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.574231 1837 raft_consensus.cc:359] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.574869 1837 raft_consensus.cc:385] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.575160 1837 raft_consensus.cc:740] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.575834 1837 consensus_queue.cc:260] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.578415 1836 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.578852 1836 ts_tablet_manager.cc:1403] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20251215 20:52:14.579195 1835 tablet_bootstrap.cc:654] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.581243 1836 raft_consensus.cc:359] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.581915 1836 raft_consensus.cc:385] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.582216 1836 raft_consensus.cc:740] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.582866 1836 consensus_queue.cc:260] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.586946 1836 ts_tablet_manager.cc:1434] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20251215 20:52:14.587062 1837 ts_tablet_manager.cc:1434] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.015s user 0.004s sys 0.004s
I20251215 20:52:14.587786 1836 tablet_bootstrap.cc:492] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.590152 1835 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.590560 1835 ts_tablet_manager.cc:1403] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.003s
I20251215 20:52:14.593088 1835 raft_consensus.cc:359] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.593701 1835 raft_consensus.cc:385] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.593969 1835 raft_consensus.cc:740] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.594086 1836 tablet_bootstrap.cc:654] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.594604 1835 consensus_queue.cc:260] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.595232 1837 tablet_bootstrap.cc:492] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.599291 1835 ts_tablet_manager.cc:1434] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20251215 20:52:14.600153 1835 tablet_bootstrap.cc:492] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.601655 1837 tablet_bootstrap.cc:654] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.605804 1835 tablet_bootstrap.cc:654] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.607766 1836 tablet_bootstrap.cc:492] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.608249 1836 ts_tablet_manager.cc:1403] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.008s
I20251215 20:52:14.610678 1836 raft_consensus.cc:359] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.611361 1836 raft_consensus.cc:385] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.611600 1836 raft_consensus.cc:740] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.612128 1837 tablet_bootstrap.cc:492] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.612563 1835 tablet_bootstrap.cc:492] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.612141 1836 consensus_queue.cc:260] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.612759 1837 ts_tablet_manager.cc:1403] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.018s user 0.017s sys 0.000s
I20251215 20:52:14.612951 1835 ts_tablet_manager.cc:1403] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20251215 20:52:14.614203 1836 ts_tablet_manager.cc:1434] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:14.615219 1836 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.615183 1835 raft_consensus.cc:359] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.615414 1837 raft_consensus.cc:359] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.615954 1835 raft_consensus.cc:385] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.616092 1837 raft_consensus.cc:385] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.616241 1835 raft_consensus.cc:740] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.616425 1837 raft_consensus.cc:740] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.616868 1835 consensus_queue.cc:260] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.617137 1837 consensus_queue.cc:260] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.620304 1868 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.620729 1868 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.621783 1835 ts_tablet_manager.cc:1434] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20251215 20:52:14.621793 1836 tablet_bootstrap.cc:654] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.622864 1863 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.623044 1868 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:14.623286 1863 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.624421 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.625039 1646 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:14.626089 1835 tablet_bootstrap.cc:492] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.626333 1837 ts_tablet_manager.cc:1434] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20251215 20:52:14.627743 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.628391 1793 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:14.629812 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.631670 1835 tablet_bootstrap.cc:654] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.634268 1837 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.635074 1841 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.635370 1760 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:14.635571 1841 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.636271 1842 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.636672 1842 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.637005 1842 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.637557 1841 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.638305 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:14.639549 1686 leader_election.cc:343] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.625125 1863 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:14.645207 1761 leader_election.cc:343] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.647413 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.646684 1687 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.649561 1837 tablet_bootstrap.cc:654] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:14.651050 1687 leader_election.cc:343] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.651510 1687 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:14.652278 1841 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.652673 1841 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.653564 1864 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.653770 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.654047 1864 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.654703 1863 raft_consensus.cc:2749] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:14.656014 1686 leader_election.cc:343] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.653592 1841 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.662007 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.662534 1864 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.663347 1793 raft_consensus.cc:2468] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:14.663601 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.664191 1646 raft_consensus.cc:2468] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:14.664563 1687 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.662318 1842 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.667179 1835 tablet_bootstrap.cc:492] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.667649 1835 ts_tablet_manager.cc:1403] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.045s user 0.019s sys 0.000s
I20251215 20:52:14.666193 1864 raft_consensus.cc:2804] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.668771 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:14.669317 1646 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.670588 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:14.670639 1835 raft_consensus.cc:359] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.671398 1835 raft_consensus.cc:385] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.671653 1835 raft_consensus.cc:740] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.668900 1864 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:52:14.671998 1761 leader_election.cc:343] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.672585 1842 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:14.672499 1835 consensus_queue.cc:260] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.672812 1864 raft_consensus.cc:3060] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.677119 1646 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:14.678143 1835 ts_tablet_manager.cc:1434] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20251215 20:52:14.678150 1760 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:14.679248 1835 tablet_bootstrap.cc:492] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.680078 1842 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:14.680539 1842 raft_consensus.cc:697] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:14.681650 1842 consensus_queue.cc:237] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.687147 1841 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.689013 1864 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.689688 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:14.690559 1835 tablet_bootstrap.cc:654] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:14.691247 1686 leader_election.cc:343] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.690883 1864 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.691340 1841 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.691993 1836 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.692651 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:14.692943 1836 ts_tablet_manager.cc:1403] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.078s user 0.031s sys 0.024s
I20251215 20:52:14.692677 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:14.693260 1793 raft_consensus.cc:3060] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.693385 1794 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.693558 1837 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.694013 1837 ts_tablet_manager.cc:1403] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.060s user 0.007s sys 0.019s
I20251215 20:52:14.695477 1836 raft_consensus.cc:359] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.696098 1836 raft_consensus.cc:385] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.696375 1836 raft_consensus.cc:740] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.697737 1836 consensus_queue.cc:260] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.696065 1837 raft_consensus.cc:359] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.698748 1837 raft_consensus.cc:385] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.698994 1837 raft_consensus.cc:740] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.699535 1837 consensus_queue.cc:260] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.699965 1836 ts_tablet_manager.cc:1434] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:52:14.700835 1836 tablet_bootstrap.cc:492] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.701475 1837 ts_tablet_manager.cc:1434] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20251215 20:52:14.702629 1837 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.700206 1793 raft_consensus.cc:2468] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:14.703776 1687 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.704562 1841 raft_consensus.cc:2804] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:14.705005 1841 raft_consensus.cc:697] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:14.705859 1841 consensus_queue.cc:237] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.706369 1836 tablet_bootstrap.cc:654] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.706647 1864 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.707187 1864 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.709102 1864 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.710124 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.711048 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.711601 1645 raft_consensus.cc:2468] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
W20251215 20:52:14.712394 1687 leader_election.cc:343] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.712667 1837 tablet_bootstrap.cc:654] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.714025 1686 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:14.720135 1864 raft_consensus.cc:2804] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.720671 1864 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.721120 1864 raft_consensus.cc:3060] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.721598 1794 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:14.724413 1837 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.727814 1687 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:14.729346 1862 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:14.730059 1863 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:14.730911 1837 ts_tablet_manager.cc:1403] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.028s user 0.018s sys 0.000s
I20251215 20:52:14.731834 1541 catalog_manager.cc:5654] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:14.733788 1837 raft_consensus.cc:359] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.731042 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:14.734484 1837 raft_consensus.cc:385] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.734795 1837 raft_consensus.cc:740] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.735656 1837 consensus_queue.cc:260] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.738042 1837 ts_tablet_manager.cc:1434] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251215 20:52:14.738863 1837 tablet_bootstrap.cc:492] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.734709 1646 raft_consensus.cc:3060] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.744331 1837 tablet_bootstrap.cc:654] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.753356 1864 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.756214 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:14.756817 1644 raft_consensus.cc:3060] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.757411 1646 raft_consensus.cc:2468] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:14.760597 1836 tablet_bootstrap.cc:492] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.761104 1836 ts_tablet_manager.cc:1403] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.060s user 0.029s sys 0.016s
I20251215 20:52:14.762151 1837 tablet_bootstrap.cc:492] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.762550 1837 ts_tablet_manager.cc:1403] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.007s
I20251215 20:52:14.764024 1644 raft_consensus.cc:2468] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:14.763942 1836 raft_consensus.cc:359] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.764832 1836 raft_consensus.cc:385] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.764808 1837 raft_consensus.cc:359] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.765161 1686 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.765363 1836 raft_consensus.cc:740] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.765618 1837 raft_consensus.cc:385] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.765957 1837 raft_consensus.cc:740] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.766075 1863 raft_consensus.cc:2804] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:14.766518 1863 raft_consensus.cc:697] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:14.766448 1837 consensus_queue.cc:260] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.766417 1836 consensus_queue.cc:260] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.767421 1863 consensus_queue.cc:237] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.768417 1837 ts_tablet_manager.cc:1434] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20251215 20:52:14.768988 1836 ts_tablet_manager.cc:1434] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:52:14.769266 1837 tablet_bootstrap.cc:492] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.770010 1836 tablet_bootstrap.cc:492] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.774395 1864 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.775278 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:14.775755 1836 tablet_bootstrap.cc:654] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.775813 1837 tablet_bootstrap.cc:654] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:14.776544 1687 leader_election.cc:343] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.788272 1835 tablet_bootstrap.cc:492] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:14.788775 1843 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.789527 1836 tablet_bootstrap.cc:492] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:14.789302 1843 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.789791 1837 tablet_bootstrap.cc:492] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:14.790148 1836 ts_tablet_manager.cc:1403] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.006s
I20251215 20:52:14.790210 1837 ts_tablet_manager.cc:1403] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.010s
I20251215 20:52:14.791189 1843 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.788771 1835 ts_tablet_manager.cc:1403] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.110s user 0.011s sys 0.000s
I20251215 20:52:14.794209 1837 raft_consensus.cc:359] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.794931 1837 raft_consensus.cc:385] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.795231 1837 raft_consensus.cc:740] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.797456 1837 consensus_queue.cc:260] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.798892 1836 raft_consensus.cc:359] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.799542 1836 raft_consensus.cc:385] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.795253 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.800698 1721 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:14.801303 1837 ts_tablet_manager.cc:1434] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.011s user 0.001s sys 0.005s
I20251215 20:52:14.800093 1836 raft_consensus.cc:740] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.802173 1612 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:14.802165 1837 tablet_bootstrap.cc:492] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:14.802798 1836 consensus_queue.cc:260] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.795535 1862 raft_consensus.cc:697] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:14.803907 1843 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.804239 1843 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.804178 1862 consensus_queue.cc:237] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.804684 1843 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.802201 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.812022 1793 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:14.813208 1843 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.814699 1843 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.815558 1837 tablet_bootstrap.cc:654] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.815703 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:14.816217 1721 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.817170 1835 raft_consensus.cc:359] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.817795 1835 raft_consensus.cc:385] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:14.818033 1835 raft_consensus.cc:740] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:14.818611 1835 consensus_queue.cc:260] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.820055 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:14.820581 1793 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.821800 1836 ts_tablet_manager.cc:1434] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20251215 20:52:14.822494 1836 tablet_bootstrap.cc:492] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:14.823884 1897 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.824466 1897 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.827199 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:14.828401 1686 leader_election.cc:343] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.829449 1793 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:14.830037 1897 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.830513 1835 ts_tablet_manager.cc:1434] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.038s user 0.005s sys 0.000s
I20251215 20:52:14.830691 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.831277 1794 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:14.831678 1843 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.832122 1843 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:14.832834 1687 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:14.831398 1835 tablet_bootstrap.cc:492] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:14.836863 1612 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:14.837224 1794 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.831914 1542 catalog_manager.cc:5654] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:14.837939 1897 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.870590 1897 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.870843 1842 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.871668 1842 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.873703 1842 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:14.894546 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.895237 1645 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:14.896466 1760 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:14.891466 1897 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.902051 1868 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.903256 1842 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20251215 20:52:14.901116 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 68351.6us
I20251215 20:52:14.913779 1721 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:14.910173 1843 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.917609 1868 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.912045 1842 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.920442 1842 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.917547 1843 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.933612 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.934286 1645 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:14.932752 1843 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.936690 1836 tablet_bootstrap.cc:654] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.920090 1868 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:14.938153 1760 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:14.944271 1897 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.943635 1542 catalog_manager.cc:5654] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:14.946322 1897 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.945961 1542 catalog_manager.cc:5654] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:14.947656 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:14.949059 1686 leader_election.cc:343] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.951414 1868 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:14.951829 1868 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:14.953429 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.954180 1719 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:14.952153 1868 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.962262 1835 tablet_bootstrap.cc:654] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:14.962728 1906 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.963860 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.964579 1719 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:14.963166 1906 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.963893 1897 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 20:52:14.966462 1906 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:14.952898 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.969434 1904 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:14.969537 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.958985 1843 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:14.970139 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:14.968182 1841 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:14.971593 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:14.973838 1863 consensus_queue.cc:1048] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:14.975183 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.976428 1721 raft_consensus.cc:2393] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:14.976493 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:14.973949 1842 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:14.980701 1862 consensus_queue.cc:1048] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:52:14.981300 1760 leader_election.cc:343] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.976943 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:14.981611 1793 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:14.987814 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:14.988401 1644 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.986012 1795 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:52:14.989602 1761 leader_election.cc:343] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:14.990075 1761 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:14.990816 1906 raft_consensus.cc:2749] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:14.996626 1612 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:14.986168 1794 raft_consensus.cc:2393] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:15.002365 1905 raft_consensus.cc:2804] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:15.002846 1905 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:15.003190 1905 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:14.979852 1904 raft_consensus.cc:697] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:14.979645 1841 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.013816 1795 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:15.015069 1687 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.016225 1862 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:15.020882 1719 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:15.022238 1612 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.026290 1841 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.216754 1842 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:15.216944 1644 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:15.218230 1837 tablet_bootstrap.cc:492] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:15.218683 1837 ts_tablet_manager.cc:1403] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.417s user 0.029s sys 0.022s
I20251215 20:52:15.218992 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:15.219558 1721 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.218514 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:15.220898 1794 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:15.221366 1837 raft_consensus.cc:359] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.222071 1837 raft_consensus.cc:385] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.222116 1836 tablet_bootstrap.cc:492] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:15.222407 1837 raft_consensus.cc:740] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.222760 1836 ts_tablet_manager.cc:1403] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.400s user 0.010s sys 0.016s
I20251215 20:52:15.223066 1837 consensus_queue.cc:260] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.194250 1863 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.024973 1862 raft_consensus.cc:697] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:15.026994 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:15.026713 1843 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.242928 1837 ts_tablet_manager.cc:1434] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.024s user 0.005s sys 0.001s
I20251215 20:52:15.244052 1837 tablet_bootstrap.cc:492] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:15.240706 1863 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.246459 1863 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.242862 1916 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.024696 1868 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.247320 1836 raft_consensus.cc:359] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.249430 1836 raft_consensus.cc:385] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.249683 1836 raft_consensus.cc:740] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.250101 1868 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:15.250444 1836 consensus_queue.cc:260] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.253163 1836 ts_tablet_manager.cc:1434] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.030s user 0.004s sys 0.003s
I20251215 20:52:15.253995 1836 tablet_bootstrap.cc:492] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:15.253885 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:15.142124 1905 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.255234 1644 raft_consensus.cc:2393] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 1: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:15.252408 1687 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:15.147150 1904 consensus_queue.cc:237] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.260411 1916 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.274988 1760 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:15.277069 1643 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.277854 1906 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:15.278311 1906 raft_consensus.cc:697] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:15.279079 1906 consensus_queue.cc:237] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.273442 1841 raft_consensus.cc:2804] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:15.281899 1841 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:15.282263 1841 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.276096 1862 consensus_queue.cc:237] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:15.284699 1687 consensus_peers.cc:597] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:15.285192 1868 consensus_queue.cc:1048] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:15.285534 1863 consensus_queue.cc:1048] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251215 20:52:15.273002 1721 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:15.290477 1646 raft_consensus.cc:2393] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 1: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:15.295146 1835 tablet_bootstrap.cc:492] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:15.295624 1835 ts_tablet_manager.cc:1403] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.464s user 0.051s sys 0.058s
I20251215 20:52:15.299203 1835 raft_consensus.cc:359] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.299665 1835 raft_consensus.cc:385] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.299867 1835 raft_consensus.cc:740] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.295677 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:15.300642 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 273333us
I20251215 20:52:15.301173 1835 consensus_queue.cc:260] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.310338 1916 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.300735 1644 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.314119 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:15.314302 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:15.320760 1795 raft_consensus.cc:2393] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:15.321072 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:15.325004 1835 ts_tablet_manager.cc:1434] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.029s user 0.005s sys 0.001s
I20251215 20:52:15.326025 1835 tablet_bootstrap.cc:492] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:15.327934 1837 tablet_bootstrap.cc:654] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.330575 1612 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.330724 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:15.333170 1843 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.343050 1841 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.343622 1835 tablet_bootstrap.cc:654] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.349296 1721 raft_consensus.cc:2393] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:15.345175 1916 raft_consensus.cc:2749] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.353624 1841 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.354059 1644 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:15.356644 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:15.357201 1795 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.359911 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:15.351500 1905 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.362080 1760 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:15.364459 1868 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:15.364930 1868 raft_consensus.cc:697] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:15.365686 1868 consensus_queue.cc:237] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.366319 1841 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 20:52:15.374419 1542 catalog_manager.cc:5654] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:15.378640 1721 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.385516 1795 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:15.388231 1612 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.389063 1916 raft_consensus.cc:2804] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:15.389961 1916 raft_consensus.cc:697] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:15.390784 1916 consensus_queue.cc:237] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.392535 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:15.393150 1719 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.400872 1836 tablet_bootstrap.cc:654] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.399012 1862 consensus_queue.cc:1048] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20251215 20:52:15.405637 1921 consensus_queue.cc:1048] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251215 20:52:15.415066 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:15.416011 1795 raft_consensus.cc:2393] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 1: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:15.418084 1541 catalog_manager.cc:5654] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:15.405158 1687 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.438805 1719 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:15.441789 1921 raft_consensus.cc:2749] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.446599 1835 tablet_bootstrap.cc:492] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:15.446965 1835 ts_tablet_manager.cc:1403] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.121s user 0.018s sys 0.006s
I20251215 20:52:15.452356 1687 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.450948 1842 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.456962 1921 raft_consensus.cc:2749] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.461274 1922 consensus_queue.cc:1048] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 20:52:15.463032 1835 raft_consensus.cc:359] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.463735 1835 raft_consensus.cc:385] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.453419 1842 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.463961 1835 raft_consensus.cc:740] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.464607 1835 consensus_queue.cc:260] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.465485 1842 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:15.466032 1592 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:52:15.468644 1835 ts_tablet_manager.cc:1434] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.021s user 0.006s sys 0.001s
I20251215 20:52:15.470925 1835 tablet_bootstrap.cc:492] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:15.474905 1837 tablet_bootstrap.cc:492] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:15.468226 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:15.475373 1837 ts_tablet_manager.cc:1403] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.232s user 0.019s sys 0.003s
I20251215 20:52:15.485625 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:15.476230 1760 leader_election.cc:343] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.486259 1721 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:15.493700 1761 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.499440 1842 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:15.499815 1842 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:15.500145 1842 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.500108 1541 catalog_manager.cc:5654] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:15.516080 1837 raft_consensus.cc:359] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.517566 1837 raft_consensus.cc:385] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.517835 1837 raft_consensus.cc:740] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.518508 1837 consensus_queue.cc:260] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.519855 1836 tablet_bootstrap.cc:492] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:15.520327 1836 ts_tablet_manager.cc:1403] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.266s user 0.022s sys 0.005s
I20251215 20:52:15.521750 1837 ts_tablet_manager.cc:1434] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.046s user 0.008s sys 0.000s
I20251215 20:52:15.522614 1837 tablet_bootstrap.cc:492] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:15.523172 1920 consensus_queue.cc:1048] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:15.505614 1541 catalog_manager.cc:5654] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:15.526958 1835 tablet_bootstrap.cc:654] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.539577 1836 raft_consensus.cc:359] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.540405 1836 raft_consensus.cc:385] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.540705 1836 raft_consensus.cc:740] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.541451 1836 consensus_queue.cc:260] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.547664 1842 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.552228 1542 catalog_manager.cc:5654] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:15.561892 1836 ts_tablet_manager.cc:1434] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.041s user 0.007s sys 0.000s
I20251215 20:52:15.562646 1836 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:15.563983 1842 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:15.564731 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:15.566411 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:15.566990 1719 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.568222 1835 tablet_bootstrap.cc:492] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:15.568724 1835 ts_tablet_manager.cc:1403] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.098s user 0.010s sys 0.004s
W20251215 20:52:15.566534 1760 leader_election.cc:343] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.572388 1835 raft_consensus.cc:359] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.573096 1835 raft_consensus.cc:385] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.573356 1835 raft_consensus.cc:740] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.573953 1835 consensus_queue.cc:260] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.579876 1836 tablet_bootstrap.cc:654] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.594789 1920 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.595290 1920 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.597178 1920 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.575275 1842 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.578449 1835 ts_tablet_manager.cc:1434] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20251215 20:52:15.597882 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:15.599311 1686 leader_election.cc:343] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.597869 1842 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.602605 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:15.603951 1760 leader_election.cc:343] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.606207 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:15.606935 1835 tablet_bootstrap.cc:492] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
W20251215 20:52:15.608278 1687 leader_election.cc:343] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.608742 1687 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.609820 1920 raft_consensus.cc:2749] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.613176 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:15.613471 1835 tablet_bootstrap.cc:654] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:15.614717 1761 leader_election.cc:343] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.615156 1761 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.616257 1836 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:15.616766 1836 ts_tablet_manager.cc:1403] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.054s user 0.018s sys 0.018s
I20251215 20:52:15.611302 1842 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:15.620675 1868 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.622212 1836 raft_consensus.cc:359] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.622845 1836 raft_consensus.cc:385] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.623111 1836 raft_consensus.cc:740] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.623696 1836 consensus_queue.cc:260] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.625042 1837 tablet_bootstrap.cc:654] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.594694 1719 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:15.627929 1761 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.628568 1842 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:15.629757 1842 raft_consensus.cc:697] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:15.630568 1842 consensus_queue.cc:237] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.631901 1836 ts_tablet_manager.cc:1434] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20251215 20:52:15.633085 1837 tablet_bootstrap.cc:492] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:15.633504 1837 ts_tablet_manager.cc:1403] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.111s user 0.009s sys 0.000s
I20251215 20:52:15.633786 1836 tablet_bootstrap.cc:492] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:15.635934 1837 raft_consensus.cc:359] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.636606 1837 raft_consensus.cc:385] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.636862 1837 raft_consensus.cc:740] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.637427 1837 consensus_queue.cc:260] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.639447 1837 ts_tablet_manager.cc:1434] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:15.641604 1837 tablet_bootstrap.cc:492] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:15.643671 1835 tablet_bootstrap.cc:492] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:15.643832 1836 tablet_bootstrap.cc:654] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.644207 1835 ts_tablet_manager.cc:1403] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.011s
I20251215 20:52:15.653164 1835 raft_consensus.cc:359] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.655179 1835 raft_consensus.cc:385] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.655572 1835 raft_consensus.cc:740] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.657191 1835 consensus_queue.cc:260] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.667618 1835 ts_tablet_manager.cc:1434] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20251215 20:52:15.670607 1835 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:15.672580 1921 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.673084 1542 catalog_manager.cc:5654] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:15.673072 1921 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.676606 1836 tablet_bootstrap.cc:492] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:15.676843 1921 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.677079 1836 ts_tablet_manager.cc:1403] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.003s
I20251215 20:52:15.678782 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:15.679766 1837 tablet_bootstrap.cc:654] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.680325 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:15.680737 1687 leader_election.cc:343] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:15.681689 1686 leader_election.cc:343] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.682134 1686 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.683145 1921 raft_consensus.cc:2749] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.686455 1836 raft_consensus.cc:359] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.687052 1836 raft_consensus.cc:385] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.687234 1836 raft_consensus.cc:740] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.687681 1836 consensus_queue.cc:260] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.691009 1836 ts_tablet_manager.cc:1434] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20251215 20:52:15.692981 1836 tablet_bootstrap.cc:492] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:15.697584 1835 tablet_bootstrap.cc:654] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.700028 1836 tablet_bootstrap.cc:654] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.710546 1837 tablet_bootstrap.cc:492] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:15.710912 1837 ts_tablet_manager.cc:1403] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.070s user 0.012s sys 0.009s
I20251215 20:52:15.711282 1835 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:15.711716 1835 ts_tablet_manager.cc:1403] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.041s user 0.011s sys 0.002s
I20251215 20:52:15.712920 1837 raft_consensus.cc:359] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.713611 1837 raft_consensus.cc:385] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.713874 1837 raft_consensus.cc:740] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.714501 1836 tablet_bootstrap.cc:492] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:15.715332 1836 ts_tablet_manager.cc:1403] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.003s
I20251215 20:52:15.717005 1835 raft_consensus.cc:359] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.717638 1835 raft_consensus.cc:385] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.717890 1835 raft_consensus.cc:740] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.717911 1842 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:15.717780 1836 raft_consensus.cc:359] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.719166 1836 raft_consensus.cc:385] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.718787 1835 consensus_queue.cc:260] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.719487 1836 raft_consensus.cc:740] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.720239 1836 consensus_queue.cc:260] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.722285 1836 ts_tablet_manager.cc:1434] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:52:15.723385 1836 tablet_bootstrap.cc:492] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:15.714560 1837 consensus_queue.cc:260] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.728813 1836 tablet_bootstrap.cc:654] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.738929 1916 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.739449 1916 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.739468 1837 ts_tablet_manager.cc:1434] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.028s user 0.005s sys 0.001s
I20251215 20:52:15.741377 1916 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.743237 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:15.744012 1721 raft_consensus.cc:2393] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:15.746104 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:15.747324 1837 tablet_bootstrap.cc:492] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:15.747671 1612 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.748752 1905 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.750319 1646 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.750538 1916 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.754284 1916 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.759327 1835 ts_tablet_manager.cc:1434] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.047s user 0.006s sys 0.001s
I20251215 20:52:15.760357 1835 tablet_bootstrap.cc:492] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:15.768982 1921 consensus_queue.cc:1048] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:15.779556 1842 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.780129 1842 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.784382 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:15.785851 1760 leader_election.cc:343] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.788635 1905 raft_consensus.cc:2749] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.803689 1837 tablet_bootstrap.cc:654] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.805019 1795 raft_consensus.cc:3060] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.805544 1916 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.809975 1835 tablet_bootstrap.cc:654] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.810913 1836 tablet_bootstrap.cc:492] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:15.811427 1836 ts_tablet_manager.cc:1403] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.088s user 0.034s sys 0.017s
I20251215 20:52:15.811102 1914 consensus_queue.cc:1048] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:15.811656 1842 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:15.814949 1836 raft_consensus.cc:359] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.815244 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:15.815729 1836 raft_consensus.cc:385] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.816097 1836 raft_consensus.cc:740] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.816000 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:15.816634 1761 leader_election.cc:343] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.817085 1761 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.817765 1842 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.821033 1836 consensus_queue.cc:260] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.820614 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:15.822763 1793 raft_consensus.cc:2468] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
W20251215 20:52:15.822974 1612 leader_election.cc:343] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.823978 1612 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.827520 1914 raft_consensus.cc:2804] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:15.827884 1914 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:15.828629 1914 raft_consensus.cc:3060] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.828256 1836 ts_tablet_manager.cc:1434] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20251215 20:52:15.830291 1836 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:15.838569 1868 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:15.841665 1921 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.842160 1921 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.843617 1914 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.849555 1914 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:15.853626 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:15.857319 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:15.857954 1793 raft_consensus.cc:3060] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:15.860795 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:15.862102 1686 leader_election.cc:343] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.864636 1921 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:15.866006 1612 leader_election.cc:343] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.871409 1862 consensus_queue.cc:1048] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:15.873243 1914 consensus_queue.cc:1048] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:15.875229 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:15.877240 1687 leader_election.cc:343] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.877667 1687 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.878647 1862 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.893715 1914 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:15.900362 1793 raft_consensus.cc:2468] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:15.909734 1836 tablet_bootstrap.cc:654] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:15.905961 1612 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.911756 1843 raft_consensus.cc:2804] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:15.912251 1843 raft_consensus.cc:697] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:15.922242 1868 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.922729 1868 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.925554 1868 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:15.913177 1843 consensus_queue.cc:237] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.926270 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:15.927759 1760 leader_election.cc:343] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.928543 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:15.936719 1761 leader_election.cc:343] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.937150 1761 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:15.939216 1837 tablet_bootstrap.cc:492] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:15.939709 1837 ts_tablet_manager.cc:1403] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.193s user 0.015s sys 0.028s
I20251215 20:52:15.948446 1914 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:15.950038 1925 raft_consensus.cc:2749] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.958213 1837 raft_consensus.cc:359] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.958962 1837 raft_consensus.cc:385] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:15.959236 1837 raft_consensus.cc:740] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:15.977473 1868 consensus_queue.cc:1048] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:15.980670 1868 consensus_queue.cc:1048] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:15.982422 1862 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:15.982934 1862 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.986109 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:15.987704 1686 leader_election.cc:343] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.959846 1837 consensus_queue.cc:260] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:15.990959 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:15.992393 1837 ts_tablet_manager.cc:1434] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.052s user 0.007s sys 0.000s
I20251215 20:52:15.993436 1837 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
W20251215 20:52:15.992512 1687 leader_election.cc:343] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:15.994432 1687 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:15.995253 1921 raft_consensus.cc:2749] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:15.986332 1862 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.009032 1905 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.009593 1905 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.011566 1905 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.014523 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.015128 1795 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:16.016462 1612 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:16.020933 1905 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.021335 1905 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.021639 1905 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.022697 1542 catalog_manager.cc:5654] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:16.028760 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.029433 1720 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:16.031782 1905 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.034391 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:16.034936 1720 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.042661 1835 tablet_bootstrap.cc:492] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.043175 1835 ts_tablet_manager.cc:1403] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.283s user 0.009s sys 0.019s
I20251215 20:52:16.050506 1868 consensus_queue.cc:1048] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:16.052354 1836 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.052441 1835 raft_consensus.cc:359] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.052863 1836 ts_tablet_manager.cc:1403] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.223s user 0.018s sys 0.007s
I20251215 20:52:16.053129 1835 raft_consensus.cc:385] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.053391 1835 raft_consensus.cc:740] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.053967 1835 consensus_queue.cc:260] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.055495 1836 raft_consensus.cc:359] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.056094 1836 raft_consensus.cc:385] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.056389 1836 raft_consensus.cc:740] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.057418 1905 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.057785 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:16.058465 1791 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.061767 1720 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:16.062940 1612 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.063745 1905 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.064399 1905 raft_consensus.cc:697] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:16.065166 1905 consensus_queue.cc:237] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.068636 1835 ts_tablet_manager.cc:1434] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.025s user 0.004s sys 0.004s
I20251215 20:52:16.069602 1836 consensus_queue.cc:260] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.056106 1837 tablet_bootstrap.cc:654] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.069545 1835 tablet_bootstrap.cc:492] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.065506 1791 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:16.075225 1836 ts_tablet_manager.cc:1434] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20251215 20:52:16.076139 1836 tablet_bootstrap.cc:492] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.080826 1837 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:16.081283 1837 ts_tablet_manager.cc:1403] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.088s user 0.011s sys 0.000s
I20251215 20:52:16.083794 1837 raft_consensus.cc:359] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.084444 1837 raft_consensus.cc:385] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.084700 1837 raft_consensus.cc:740] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.085502 1835 tablet_bootstrap.cc:654] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.087615 1836 tablet_bootstrap.cc:654] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.089489 1837 consensus_queue.cc:260] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.094538 1842 consensus_queue.cc:1048] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:16.095700 1837 ts_tablet_manager.cc:1434] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20251215 20:52:16.096571 1837 tablet_bootstrap.cc:492] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:16.097024 1835 tablet_bootstrap.cc:492] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.097425 1835 ts_tablet_manager.cc:1403] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.028s user 0.011s sys 0.005s
I20251215 20:52:16.102851 1835 raft_consensus.cc:359] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.103543 1835 raft_consensus.cc:385] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.103785 1835 raft_consensus.cc:740] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.104421 1835 consensus_queue.cc:260] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.106525 1835 ts_tablet_manager.cc:1434] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20251215 20:52:16.107501 1835 tablet_bootstrap.cc:492] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.099952 1543 catalog_manager.cc:5654] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:16.113307 1837 tablet_bootstrap.cc:654] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.115437 1836 tablet_bootstrap.cc:492] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.115831 1836 ts_tablet_manager.cc:1403] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.040s user 0.011s sys 0.009s
I20251215 20:52:16.118217 1836 raft_consensus.cc:359] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.118655 1836 raft_consensus.cc:385] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.118917 1836 raft_consensus.cc:740] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.119514 1836 consensus_queue.cc:260] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.120970 1835 tablet_bootstrap.cc:654] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.120982 1836 ts_tablet_manager.cc:1434] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:52:16.121942 1836 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.124426 1905 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.124881 1905 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.126678 1905 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.127151 1835 tablet_bootstrap.cc:492] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.127568 1835 ts_tablet_manager.cc:1403] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.002s
I20251215 20:52:16.127710 1836 tablet_bootstrap.cc:654] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.128741 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.129722 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:16.129985 1612 leader_election.cc:343] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.130280 1842 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.130717 1842 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:16.131465 1612 leader_election.cc:343] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.131909 1612 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:16.132078 1835 raft_consensus.cc:359] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.132556 1842 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.132754 1835 raft_consensus.cc:385] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.133034 1835 raft_consensus.cc:740] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.133224 1905 raft_consensus.cc:2749] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:16.133625 1835 consensus_queue.cc:260] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.134351 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:16.135576 1760 leader_election.cc:343] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.136018 1837 tablet_bootstrap.cc:492] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:16.136451 1837 ts_tablet_manager.cc:1403] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.000s
I20251215 20:52:16.137315 1921 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.137745 1921 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.138593 1837 raft_consensus.cc:359] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.139191 1837 raft_consensus.cc:385] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.139441 1837 raft_consensus.cc:740] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.139560 1921 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.140617 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.140021 1837 consensus_queue.cc:260] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.143451 1837 ts_tablet_manager.cc:1434] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251215 20:52:16.144265 1837 tablet_bootstrap.cc:492] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
W20251215 20:52:16.146430 1761 leader_election.cc:343] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.146925 1836 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.147377 1836 ts_tablet_manager.cc:1403] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.007s
I20251215 20:52:16.147476 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.146867 1761 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:16.149665 1686 leader_election.cc:343] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.149819 1836 raft_consensus.cc:359] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.150475 1836 raft_consensus.cc:385] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.150561 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.150823 1836 raft_consensus.cc:740] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.151139 1837 tablet_bootstrap.cc:654] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:16.151659 1687 leader_election.cc:343] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.151515 1836 consensus_queue.cc:260] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.152094 1687 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:16.149677 1842 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:16.153316 1921 raft_consensus.cc:2749] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:16.149703 1835 ts_tablet_manager.cc:1434] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20251215 20:52:16.153789 1836 ts_tablet_manager.cc:1434] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20251215 20:52:16.154675 1836 tablet_bootstrap.cc:492] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.154731 1835 tablet_bootstrap.cc:492] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.161391 1836 tablet_bootstrap.cc:654] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.163622 1835 tablet_bootstrap.cc:654] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.169768 1837 tablet_bootstrap.cc:492] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:16.170150 1837 ts_tablet_manager.cc:1403] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.026s user 0.019s sys 0.003s
I20251215 20:52:16.172844 1837 raft_consensus.cc:359] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.173420 1836 tablet_bootstrap.cc:492] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.173484 1837 raft_consensus.cc:385] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.173746 1836 ts_tablet_manager.cc:1403] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.004s
I20251215 20:52:16.173818 1837 raft_consensus.cc:740] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.174571 1837 consensus_queue.cc:260] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.176103 1835 tablet_bootstrap.cc:492] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.176103 1836 raft_consensus.cc:359] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.176705 1835 ts_tablet_manager.cc:1403] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.000s
I20251215 20:52:16.176908 1836 raft_consensus.cc:385] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.177181 1836 raft_consensus.cc:740] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.177853 1836 consensus_queue.cc:260] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.179183 1835 raft_consensus.cc:359] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.179782 1835 raft_consensus.cc:385] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.180020 1835 raft_consensus.cc:740] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.180110 1836 ts_tablet_manager.cc:1434] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20251215 20:52:16.180624 1835 consensus_queue.cc:260] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.181653 1836 tablet_bootstrap.cc:492] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.182390 1835 ts_tablet_manager.cc:1434] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:52:16.185161 1920 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.185251 1837 ts_tablet_manager.cc:1434] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20251215 20:52:16.185782 1920 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:16.186710 1835 tablet_bootstrap.cc:492] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.187364 1920 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:16.188504 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.189091 1645 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:16.190613 1686 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.192173 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.192773 1791 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:16.193022 1835 tablet_bootstrap.cc:654] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.198027 1837 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:16.200265 1836 tablet_bootstrap.cc:654] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.201865 1905 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.202386 1905 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.202440 1920 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:16.205821 1920 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.206195 1920 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:16.207974 1905 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.208088 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.209218 1718 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:16.210172 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.210462 1612 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.210850 1791 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:16.211807 1905 raft_consensus.cc:2804] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.212992 1905 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.213368 1905 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.217711 1920 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:16.219254 1920 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:16.219923 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:16.220124 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:16.220463 1791 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:16.220678 1645 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:16.229436 1835 tablet_bootstrap.cc:492] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.229961 1835 ts_tablet_manager.cc:1403] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.043s user 0.020s sys 0.007s
I20251215 20:52:16.233095 1836 tablet_bootstrap.cc:492] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.233554 1836 ts_tablet_manager.cc:1403] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.052s user 0.013s sys 0.005s
I20251215 20:52:16.233729 1791 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:16.234740 1687 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.235671 1920 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:16.235541 1835 raft_consensus.cc:359] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.236188 1835 raft_consensus.cc:385] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.236560 1837 tablet_bootstrap.cc:654] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.236493 1835 raft_consensus.cc:740] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.236784 1920 raft_consensus.cc:697] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:16.237196 1835 consensus_queue.cc:260] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.237674 1920 consensus_queue.cc:237] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:16.235844 1836 raft_consensus.cc:359] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.239306 1836 raft_consensus.cc:385] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.239580 1836 raft_consensus.cc:740] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.240176 1836 consensus_queue.cc:260] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.241037 1835 ts_tablet_manager.cc:1434] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20251215 20:52:16.241283 1905 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.241904 1835 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.242264 1836 ts_tablet_manager.cc:1434] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.008s user 0.004s sys 0.001s
I20251215 20:52:16.243083 1836 tablet_bootstrap.cc:492] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.239811 1645 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:16.243932 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:16.244490 1718 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.245674 1905 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.247370 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:16.247889 1791 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.249572 1862 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.250001 1862 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.250864 1835 tablet_bootstrap.cc:654] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.251758 1862 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.253908 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.254515 1795 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:16.254647 1791 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:16.255517 1612 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:16.255648 1687 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.256382 1905 raft_consensus.cc:2804] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.253916 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.256858 1905 raft_consensus.cc:697] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:16.258069 1905 consensus_queue.cc:237] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.258641 1718 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:16.259721 1836 tablet_bootstrap.cc:654] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.260084 1843 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.260582 1843 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.256477 1862 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.262337 1862 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.262648 1862 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:52:16.266418 1686 leader_election.cc:343] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.269294 1542 catalog_manager.cc:5654] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 2, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 2 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:16.267491 1906 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.289939 1862 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.292413 1843 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.285650 1906 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.293766 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.294986 1906 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.295809 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.296470 1718 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:16.296855 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.298391 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:16.299719 1761 leader_election.cc:343] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:16.300933 1760 leader_election.cc:343] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.301383 1760 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:16.301206 1612 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.302433 1906 raft_consensus.cc:2749] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:16.302703 1612 leader_election.cc:343] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.304348 1843 raft_consensus.cc:2804] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.304553 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:16.306030 1686 leader_election.cc:343] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.304736 1843 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.306651 1843 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.313335 1843 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.316646 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:16.317255 1719 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.324065 1719 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:16.325374 1612 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.326210 1904 raft_consensus.cc:2804] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.326719 1904 raft_consensus.cc:697] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:16.327534 1904 consensus_queue.cc:237] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.328871 1921 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.329440 1921 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.328802 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:16.329360 1862 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.330384 1791 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.332799 1837 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:16.333318 1837 ts_tablet_manager.cc:1403] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.135s user 0.021s sys 0.024s
I20251215 20:52:16.335336 1835 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.335736 1835 ts_tablet_manager.cc:1403] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.094s user 0.013s sys 0.039s
I20251215 20:52:16.336267 1837 raft_consensus.cc:359] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.336603 1921 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.336911 1837 raft_consensus.cc:385] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.337208 1837 raft_consensus.cc:740] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.338218 1835 raft_consensus.cc:359] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.338557 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.338847 1835 raft_consensus.cc:385] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.338848 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.339144 1795 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:16.339531 1645 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:16.340022 1843 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.340494 1835 raft_consensus.cc:740] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.340794 1686 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.341091 1835 consensus_queue.cc:260] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.341629 1836 tablet_bootstrap.cc:492] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.342042 1836 ts_tablet_manager.cc:1403] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.099s user 0.011s sys 0.032s
I20251215 20:52:16.342499 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:16.342072 1543 catalog_manager.cc:5654] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:16.343194 1835 ts_tablet_manager.cc:1434] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20251215 20:52:16.343973 1835 tablet_bootstrap.cc:492] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.344435 1836 raft_consensus.cc:359] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.345028 1836 raft_consensus.cc:385] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.345263 1836 raft_consensus.cc:740] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.346101 1837 consensus_queue.cc:260] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.349135 1862 raft_consensus.cc:2804] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.349495 1862 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.349800 1862 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.348613 1836 consensus_queue.cc:260] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.350548 1835 tablet_bootstrap.cc:654] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.357046 1837 ts_tablet_manager.cc:1434] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20251215 20:52:16.357867 1836 ts_tablet_manager.cc:1434] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
W20251215 20:52:16.352083 1612 leader_election.cc:343] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.359294 1836 tablet_bootstrap.cc:492] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.357944 1837 tablet_bootstrap.cc:492] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:16.367359 1836 tablet_bootstrap.cc:654] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.368235 1837 tablet_bootstrap.cc:654] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.374799 1862 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.385878 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:16.381532 1905 consensus_queue.cc:1048] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20251215 20:52:16.386523 1645 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.391353 1862 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.393318 1791 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:16.404636 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:16.405817 1791 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.405192 1687 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:16.409982 1862 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.408967 1645 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:16.411723 1686 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.406888 1543 catalog_manager.cc:5654] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:16.412528 1920 raft_consensus.cc:2804] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.412990 1920 raft_consensus.cc:697] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:16.414453 1862 raft_consensus.cc:697] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:16.413739 1920 consensus_queue.cc:237] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.415249 1862 consensus_queue.cc:237] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.422166 1836 tablet_bootstrap.cc:492] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.422605 1836 ts_tablet_manager.cc:1403] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.063s user 0.017s sys 0.003s
I20251215 20:52:16.422887 1718 raft_consensus.cc:3060] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.425156 1835 tablet_bootstrap.cc:492] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.425557 1835 ts_tablet_manager.cc:1403] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.082s user 0.024s sys 0.000s
I20251215 20:52:16.429793 1835 raft_consensus.cc:359] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.433784 1835 raft_consensus.cc:385] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.434008 1835 raft_consensus.cc:740] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.434497 1835 consensus_queue.cc:260] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.437103 1836 raft_consensus.cc:359] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.437714 1836 raft_consensus.cc:385] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.437947 1836 raft_consensus.cc:740] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.438504 1836 consensus_queue.cc:260] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.441103 1836 ts_tablet_manager.cc:1434] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.018s user 0.006s sys 0.001s
I20251215 20:52:16.443578 1836 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.445708 1835 ts_tablet_manager.cc:1434] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.020s user 0.006s sys 0.001s
I20251215 20:52:16.447314 1835 tablet_bootstrap.cc:492] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.446296 1905 consensus_queue.cc:1048] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 20:52:16.430110 1791 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:16.453727 1837 tablet_bootstrap.cc:492] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:16.454237 1837 ts_tablet_manager.cc:1403] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.096s user 0.010s sys 0.005s
I20251215 20:52:16.459043 1541 catalog_manager.cc:5654] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:16.461297 1837 raft_consensus.cc:359] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.463450 1837 raft_consensus.cc:385] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.463704 1837 raft_consensus.cc:740] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.465374 1837 consensus_queue.cc:260] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.467432 1837 ts_tablet_manager.cc:1434] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.013s user 0.003s sys 0.002s
I20251215 20:52:16.469937 1922 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.470444 1922 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.473033 1922 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.474503 1835 tablet_bootstrap.cc:654] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.475036 1837 tablet_bootstrap.cc:492] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:16.477319 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.477675 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.478291 1719 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
W20251215 20:52:16.478681 1760 leader_election.cc:343] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.479419 1761 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:16.482581 1922 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.483385 1922 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.483714 1922 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.493961 1541 catalog_manager.cc:5654] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:16.498963 1836 tablet_bootstrap.cc:654] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.502669 1904 consensus_queue.cc:1048] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:16.510572 1837 tablet_bootstrap.cc:654] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.511350 1835 tablet_bootstrap.cc:492] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.511749 1835 ts_tablet_manager.cc:1403] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.027s
I20251215 20:52:16.513391 1842 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.513836 1842 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.514410 1922 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.515545 1842 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.527397 1922 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:16.529264 1592 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:52:16.530215 1835 raft_consensus.cc:359] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.531003 1835 raft_consensus.cc:385] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.530656 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:16.530184 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.531277 1835 raft_consensus.cc:740] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.532155 1835 consensus_queue.cc:260] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:16.533001 1760 leader_election.cc:343] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.533272 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:16.534184 1760 leader_election.cc:343] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.534358 1719 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.540540 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.541257 1718 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:16.542230 1835 ts_tablet_manager.cc:1434] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.030s user 0.012s sys 0.006s
I20251215 20:52:16.542339 1761 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:16.543076 1719 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:16.543675 1922 raft_consensus.cc:2804] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.544140 1922 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.544533 1922 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.549616 1761 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:16.550869 1842 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.551257 1835 tablet_bootstrap.cc:492] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.551402 1842 raft_consensus.cc:697] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:16.553365 1842 consensus_queue.cc:237] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.556751 1906 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.557538 1835 tablet_bootstrap.cc:654] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.557279 1906 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.559333 1906 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.559610 1836 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.560123 1836 ts_tablet_manager.cc:1403] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.117s user 0.009s sys 0.006s
I20251215 20:52:16.560971 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:16.562359 1760 leader_election.cc:343] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.564006 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.565078 1835 tablet_bootstrap.cc:492] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.565492 1835 ts_tablet_manager.cc:1403] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20251215 20:52:16.568074 1922 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:16.568825 1761 leader_election.cc:343] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.570353 1761 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:16.572322 1922 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.572901 1922 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:16.573024 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:16.573835 1836 raft_consensus.cc:359] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:16.574295 1760 leader_election.cc:343] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.574468 1836 raft_consensus.cc:385] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.574744 1836 raft_consensus.cc:740] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.569005 1835 raft_consensus.cc:359] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.575583 1835 raft_consensus.cc:385] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.575336 1836 consensus_queue.cc:260] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.575860 1835 raft_consensus.cc:740] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.576758 1835 consensus_queue.cc:260] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.577880 1836 ts_tablet_manager.cc:1434] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20251215 20:52:16.578811 1836 tablet_bootstrap.cc:492] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.575719 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:16.582056 1835 ts_tablet_manager.cc:1434] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20251215 20:52:16.582897 1835 tablet_bootstrap.cc:492] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.587026 1916 consensus_queue.cc:1048] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:16.588373 1719 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.589039 1843 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.593343 1843 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.595638 1843 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.597565 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.598147 1721 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:16.601409 1612 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:16.602723 1916 raft_consensus.cc:2804] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.601670 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.603681 1791 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:16.603735 1835 tablet_bootstrap.cc:654] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.605019 1719 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:16.603351 1541 catalog_manager.cc:5654] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:16.603135 1916 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.604921 1836 tablet_bootstrap.cc:654] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.606223 1916 raft_consensus.cc:3060] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.613154 1916 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.616231 1837 tablet_bootstrap.cc:492] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:16.616714 1837 ts_tablet_manager.cc:1403] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.142s user 0.018s sys 0.040s
I20251215 20:52:16.616626 1761 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:16.617784 1842 raft_consensus.cc:2804] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.618301 1842 raft_consensus.cc:697] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:16.619087 1837 raft_consensus.cc:359] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.619742 1837 raft_consensus.cc:385] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.619995 1837 raft_consensus.cc:740] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.621034 1835 tablet_bootstrap.cc:492] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.619122 1842 consensus_queue.cc:237] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.621447 1835 ts_tablet_manager.cc:1403] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.005s
I20251215 20:52:16.623216 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:16.623750 1719 raft_consensus.cc:3060] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.624934 1922 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.625429 1922 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.626223 1835 raft_consensus.cc:359] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.627367 1922 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.628746 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.629367 1646 raft_consensus.cc:2468] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:16.630017 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:16.631100 1761 leader_election.cc:343] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.631443 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:16.631965 1791 raft_consensus.cc:3060] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.634400 1760 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:16.620687 1837 consensus_queue.cc:260] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.635548 1922 raft_consensus.cc:2804] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.635896 1922 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.636215 1922 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.636963 1837 ts_tablet_manager.cc:1434] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20251215 20:52:16.643101 1922 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.626849 1835 raft_consensus.cc:385] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.646404 1835 raft_consensus.cc:740] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.647147 1835 consensus_queue.cc:260] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.649104 1836 tablet_bootstrap.cc:492] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.649502 1835 ts_tablet_manager.cc:1434] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.028s user 0.005s sys 0.002s
I20251215 20:52:16.649596 1836 ts_tablet_manager.cc:1403] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.071s user 0.024s sys 0.022s
I20251215 20:52:16.650434 1835 tablet_bootstrap.cc:492] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.652117 1836 raft_consensus.cc:359] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.652853 1836 raft_consensus.cc:385] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.653168 1836 raft_consensus.cc:740] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.653632 1791 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:16.653883 1836 consensus_queue.cc:260] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.654825 1612 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:16.655789 1843 raft_consensus.cc:2804] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.656086 1835 tablet_bootstrap.cc:654] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.656236 1843 raft_consensus.cc:697] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:16.656675 1836 ts_tablet_manager.cc:1434] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20251215 20:52:16.656574 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:16.657512 1837 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:16.660187 1646 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.657740 1916 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.660983 1843 consensus_queue.cc:237] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.630045 1719 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:16.658809 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:16.662672 1906 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.659113 1922 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.663087 1906 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.664944 1906 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.666486 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.667158 1645 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:16.667667 1646 raft_consensus.cc:2468] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:16.668363 1760 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:16.669109 1761 leader_election.cc:343] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.670111 1922 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.670503 1922 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.670817 1922 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.673969 1920 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.674476 1920 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.682747 1920 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.694820 1836 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.696153 1922 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.717195 1760 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:16.718571 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.721745 1922 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.723402 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:16.726480 1645 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.726588 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.727160 1719 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:16.727810 1906 raft_consensus.cc:2804] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
W20251215 20:52:16.738577 1686 leader_election.cc:343] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.747670 1543 catalog_manager.cc:5654] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:16.748993 1645 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:16.752180 1916 consensus_queue.cc:1048] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:16.753409 1842 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.753856 1842 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.757925 1842 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:16.764889 1836 tablet_bootstrap.cc:654] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.765565 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.766352 1920 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.770709 1920 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.766191 1906 raft_consensus.cc:697] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:16.769747 1791 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:16.771993 1906 consensus_queue.cc:237] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.773031 1920 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.774570 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:16.776037 1686 leader_election.cc:343] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.775911 1916 consensus_queue.cc:1048] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:16.776638 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:16.767066 1760 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:16.779078 1720 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.781066 1835 tablet_bootstrap.cc:492] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:16.781674 2003 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:16.782687 2003 raft_consensus.cc:697] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:16.783452 1835 ts_tablet_manager.cc:1403] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.133s user 0.015s sys 0.024s
I20251215 20:52:16.783779 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:16.789373 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.790638 1791 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.793917 1837 tablet_bootstrap.cc:654] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.795634 1541 catalog_manager.cc:5654] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:16.798386 1916 consensus_queue.cc:1048] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:16.803972 1794 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 20:52:16.805583 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.809819 1835 raft_consensus.cc:359] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.810523 1835 raft_consensus.cc:385] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.810737 1835 raft_consensus.cc:740] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.808939 1794 raft_consensus.cc:2468] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:16.812673 1761 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:16.813061 1835 consensus_queue.cc:260] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.814241 1906 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:16.791864 2003 consensus_queue.cc:237] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.815058 1835 ts_tablet_manager.cc:1434] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20251215 20:52:16.815932 1835 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:16.820066 1916 consensus_queue.cc:1048] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:16.822813 1720 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:16.826550 1687 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:16.833190 1920 raft_consensus.cc:2804] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.833379 1836 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:16.833585 1920 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.833827 1836 ts_tablet_manager.cc:1403] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.139s user 0.009s sys 0.008s
I20251215 20:52:16.834004 1920 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.835156 1687 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:16.841084 1835 tablet_bootstrap.cc:654] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:16.841811 1921 raft_consensus.cc:2804] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:16.842483 1921 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:16.842826 1921 raft_consensus.cc:3060] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:16.837893 1836 raft_consensus.cc:359] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.846778 1836 raft_consensus.cc:385] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:16.847010 1836 raft_consensus.cc:740] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:16.847517 1836 consensus_queue.cc:260] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.837509 1862 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20251215 20:52:16.859448 1843 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.860005 1843 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.862120 1843 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.866607 1921 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.869438 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:16.869689 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:16.870683 1612 leader_election.cc:343] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:16.870887 1686 leader_election.cc:343] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:16.884181 1836 ts_tablet_manager.cc:1434] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.050s user 0.006s sys 0.001s
I20251215 20:52:16.860106 1920 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.889858 1837 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:16.896984 1862 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.897480 1862 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:16.899282 1862 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.888597 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:16.902733 1720 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
W20251215 20:52:16.884634 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 49562.6us
I20251215 20:52:16.929569 2003 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:16.947268 2003 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:16.949440 2010 log.cc:927] Time spent T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20251215 20:52:16.960889 1920 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.973346 1837 ts_tablet_manager.cc:1403] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.316s user 0.047s sys 0.033s
I20251215 20:52:16.973523 1836 tablet_bootstrap.cc:492] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:16.957818 1921 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:16.986349 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:16.988579 1543 catalog_manager.cc:5654] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:16.990949 1543 catalog_manager.cc:5654] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:16.993942 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.003152 1612 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
W20251215 20:52:17.004700 1760 consensus_peers.cc:597] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:17.004441 1837 raft_consensus.cc:359] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.005124 1837 raft_consensus.cc:385] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.005239 1904 raft_consensus.cc:2804] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:17.005618 1904 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:17.005935 1904 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.005966 1837 raft_consensus.cc:740] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.006702 1837 consensus_queue.cc:260] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.007364 1835 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.007774 1835 ts_tablet_manager.cc:1403] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.192s user 0.015s sys 0.001s
W20251215 20:52:17.012925 1686 leader_election.cc:343] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:17.013707 1686 leader_election.cc:343] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.014577 1835 raft_consensus.cc:359] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.015192 1835 raft_consensus.cc:385] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.015448 1835 raft_consensus.cc:740] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.015995 1835 consensus_queue.cc:260] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.016124 1645 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 20:52:17.021179 1835 ts_tablet_manager.cc:1434] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20251215 20:52:17.022827 1904 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.025374 1835 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.025553 2003 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:17.027361 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.028174 1904 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:17.028599 1760 leader_election.cc:343] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.030409 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:17.031787 1612 leader_election.cc:343] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.032464 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:17.032657 1837 ts_tablet_manager.cc:1434] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.058s user 0.006s sys 0.000s
I20251215 20:52:17.033691 1837 tablet_bootstrap.cc:492] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.033279 1718 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.044636 1921 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.037158 2015 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20251215 20:52:17.055871 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:17.060351 1835 tablet_bootstrap.cc:654] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.050967 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.060904 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:17.064515 1791 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:17.065071 1794 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.063988 1792 raft_consensus.cc:3060] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.061591 1921 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.075919 1646 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.078004 1718 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:17.079247 1792 raft_consensus.cc:2468] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:17.079582 1612 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:17.080047 1920 consensus_queue.cc:1048] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.080509 1794 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:17.081005 1904 raft_consensus.cc:2804] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.081630 1904 raft_consensus.cc:697] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:17.082499 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.082445 1904 consensus_queue.cc:237] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.083801 1836 tablet_bootstrap.cc:654] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:17.084842 1686 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:17.085057 1837 tablet_bootstrap.cc:654] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.086261 1921 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.089977 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.092496 2003 consensus_queue.cc:1048] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:52:17.098260 1761 leader_election.cc:343] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.098750 1761 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.104171 2001 raft_consensus.cc:2749] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.106153 1835 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.106158 1837 tablet_bootstrap.cc:492] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:17.106849 1835 ts_tablet_manager.cc:1403] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.082s user 0.011s sys 0.001s
I20251215 20:52:17.108099 1837 ts_tablet_manager.cc:1403] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.073s user 0.009s sys 0.004s
I20251215 20:52:17.108397 1543 catalog_manager.cc:5654] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:17.110668 1837 raft_consensus.cc:359] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.111344 1837 raft_consensus.cc:385] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.111624 1837 raft_consensus.cc:740] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.110970 1835 raft_consensus.cc:359] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.113095 1835 raft_consensus.cc:385] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.112794 1837 consensus_queue.cc:260] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.113847 1835 raft_consensus.cc:740] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.114775 1835 consensus_queue.cc:260] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.117545 1835 ts_tablet_manager.cc:1434] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20251215 20:52:17.118299 1835 tablet_bootstrap.cc:492] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.115224 1837 ts_tablet_manager.cc:1434] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20251215 20:52:17.121809 1921 consensus_queue.cc:1048] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.123937 1835 tablet_bootstrap.cc:654] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.125974 1836 tablet_bootstrap.cc:492] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.126083 1837 tablet_bootstrap.cc:492] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.126500 1836 ts_tablet_manager.cc:1403] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.153s user 0.016s sys 0.004s
I20251215 20:52:17.126483 2015 consensus_queue.cc:1048] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.129144 1687 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.129033 1836 raft_consensus.cc:359] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:17.126256 1686 leader_election.cc:343] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.130288 1687 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.131294 1862 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:17.131361 1687 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.131708 1862 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:17.132055 1862 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.136473 1920 raft_consensus.cc:2804] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.139111 1862 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.140522 1836 raft_consensus.cc:385] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.140830 1836 raft_consensus.cc:740] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.141440 1836 consensus_queue.cc:260] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.143513 1836 ts_tablet_manager.cc:1434] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20251215 20:52:17.144445 1836 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:17.144716 1921 raft_consensus.cc:2804] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.145233 1921 raft_consensus.cc:697] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:17.146143 1921 consensus_queue.cc:237] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.149811 1836 tablet_bootstrap.cc:654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.149927 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.152122 1837 tablet_bootstrap.cc:654] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.160804 1836 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.161571 1836 ts_tablet_manager.cc:1403] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.017s user 0.016s sys 0.000s
I20251215 20:52:17.164033 1836 raft_consensus.cc:359] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.164752 1836 raft_consensus.cc:385] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.165014 1836 raft_consensus.cc:740] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.165624 1836 consensus_queue.cc:260] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.175518 1862 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:17.178084 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 43726.3us
I20251215 20:52:17.182533 1836 ts_tablet_manager.cc:1434] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20251215 20:52:17.182435 1920 raft_consensus.cc:697] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:17.184743 1836 tablet_bootstrap.cc:492] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
W20251215 20:52:17.188480 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 47129.8us
I20251215 20:52:17.191836 1837 tablet_bootstrap.cc:492] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:17.192224 1837 ts_tablet_manager.cc:1403] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.066s user 0.008s sys 0.004s
W20251215 20:52:17.195180 1687 leader_election.cc:343] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.196108 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:17.198623 1836 tablet_bootstrap.cc:654] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.199203 1687 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:17.200995 1686 leader_election.cc:343] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.195798 1920 consensus_queue.cc:237] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.199216 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:17.203225 1794 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.203658 1837 raft_consensus.cc:359] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.204603 1837 raft_consensus.cc:385] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.204866 1837 raft_consensus.cc:740] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.205416 1837 consensus_queue.cc:260] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.207608 1837 ts_tablet_manager.cc:1434] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20251215 20:52:17.207623 1843 consensus_queue.cc:1048] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:17.208508 1837 tablet_bootstrap.cc:492] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.212316 2013 raft_consensus.cc:2749] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.230717 1835 tablet_bootstrap.cc:492] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.231207 1835 ts_tablet_manager.cc:1403] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.113s user 0.009s sys 0.004s
I20251215 20:52:17.233175 1837 tablet_bootstrap.cc:654] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.233678 1921 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.234148 1921 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.234666 2001 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.235153 2001 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.236624 1921 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.241614 1904 consensus_queue.cc:1048] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.237011 2001 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:17.238416 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:17.247153 1760 leader_election.cc:343] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.239194 1836 tablet_bootstrap.cc:492] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.247929 1836 ts_tablet_manager.cc:1403] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.063s user 0.015s sys 0.008s
I20251215 20:52:17.250413 1836 raft_consensus.cc:359] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.251044 1836 raft_consensus.cc:385] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.251307 1836 raft_consensus.cc:740] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.251693 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.239092 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.241161 1837 tablet_bootstrap.cc:492] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:17.253413 1837 ts_tablet_manager.cc:1403] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.045s user 0.007s sys 0.012s
I20251215 20:52:17.251631 1542 catalog_manager.cc:5654] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
W20251215 20:52:17.254583 1686 leader_election.cc:343] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.255843 1837 raft_consensus.cc:359] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.256470 1837 raft_consensus.cc:385] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.256711 1837 raft_consensus.cc:740] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.257367 1837 consensus_queue.cc:260] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.257658 1835 raft_consensus.cc:359] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.258276 1835 raft_consensus.cc:385] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.258546 1835 raft_consensus.cc:740] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.259130 1835 consensus_queue.cc:260] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.259629 1837 ts_tablet_manager.cc:1434] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:52:17.251889 1836 consensus_queue.cc:260] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.262349 1836 ts_tablet_manager.cc:1434] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.014s user 0.001s sys 0.006s
I20251215 20:52:17.263568 1836 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:17.263828 1794 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:17.264721 2001 consensus_queue.cc:1048] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.268535 2001 consensus_queue.cc:1048] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20251215 20:52:17.270663 1761 leader_election.cc:343] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.271163 1761 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.271906 2001 raft_consensus.cc:2749] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.272533 1837 tablet_bootstrap.cc:492] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.279295 1836 tablet_bootstrap.cc:654] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.280550 1835 ts_tablet_manager.cc:1434] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.049s user 0.003s sys 0.006s
I20251215 20:52:17.281256 1835 tablet_bootstrap.cc:492] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.284983 1544 catalog_manager.cc:5654] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:17.289486 1687 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.290218 1862 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.290652 1862 raft_consensus.cc:697] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:17.291625 2001 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.292119 1862 consensus_queue.cc:237] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.301316 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:17.319247 1687 leader_election.cc:343] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.319653 1687 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.322166 1843 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.324671 2025 raft_consensus.cc:2749] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.322641 1843 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.332012 1837 tablet_bootstrap.cc:654] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.341930 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.346549 1916 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.347005 1916 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.347586 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.348767 1916 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.349381 1843 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.351418 1543 catalog_manager.cc:5654] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:17.354687 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.354933 1612 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.355818 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.356537 1795 raft_consensus.cc:2393] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:17.360761 1718 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.371517 2001 consensus_queue.cc:1048] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:17.373092 1612 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.373796 1916 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.369195 1843 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.380080 1835 tablet_bootstrap.cc:654] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.383978 2001 consensus_queue.cc:1048] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 20:52:17.393909 1916 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.397532 1843 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.397955 1843 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.399494 1843 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.400200 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.401083 2002 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:17.402572 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.403313 1794 raft_consensus.cc:2393] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:17.408776 1836 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.409230 1836 ts_tablet_manager.cc:1403] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.146s user 0.009s sys 0.009s
I20251215 20:52:17.411044 1612 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.419435 1905 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.427750 1837 tablet_bootstrap.cc:492] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:17.428220 1837 ts_tablet_manager.cc:1403] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.157s user 0.022s sys 0.006s
I20251215 20:52:17.428216 1905 raft_consensus.cc:2749] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.415323 1836 raft_consensus.cc:359] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.431010 1837 raft_consensus.cc:359] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.431682 1837 raft_consensus.cc:385] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.431936 1837 raft_consensus.cc:740] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.432569 1837 consensus_queue.cc:260] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.434684 1837 ts_tablet_manager.cc:1434] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:52:17.435454 1837 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.436175 1835 tablet_bootstrap.cc:492] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.436630 1835 ts_tablet_manager.cc:1403] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.156s user 0.004s sys 0.008s
I20251215 20:52:17.438915 1835 raft_consensus.cc:359] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.439569 1835 raft_consensus.cc:385] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.439805 1835 raft_consensus.cc:740] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.440364 1835 consensus_queue.cc:260] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.441601 1837 tablet_bootstrap.cc:654] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.442426 1835 ts_tablet_manager.cc:1434] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:17.443329 1835 tablet_bootstrap.cc:492] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.431010 1836 raft_consensus.cc:385] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.445730 1836 raft_consensus.cc:740] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.446265 1836 consensus_queue.cc:260] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.446797 2025 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.447402 2025 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.448506 1836 ts_tablet_manager.cc:1434] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.039s user 0.005s sys 0.002s
I20251215 20:52:17.449457 1836 tablet_bootstrap.cc:492] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:17.449554 2025 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.450690 1837 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:17.451121 1837 ts_tablet_manager.cc:1403] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.000s
I20251215 20:52:17.451167 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.452113 1835 tablet_bootstrap.cc:654] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.453416 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.454345 1794 raft_consensus.cc:2468] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
W20251215 20:52:17.453744 1686 leader_election.cc:343] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.455986 1687 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.457055 2025 raft_consensus.cc:2804] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:17.456996 1837 raft_consensus.cc:359] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.457487 2025 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:17.457991 1836 tablet_bootstrap.cc:654] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.457831 2025 raft_consensus.cc:3060] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.465667 2025 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.468400 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:17.469677 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:17.470285 2025 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.457731 1837 raft_consensus.cc:385] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 20:52:17.470547 1686 leader_election.cc:343] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.470868 1837 raft_consensus.cc:740] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.470285 1794 raft_consensus.cc:3060] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.471500 1837 consensus_queue.cc:260] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.472033 1835 tablet_bootstrap.cc:492] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.472615 1835 ts_tablet_manager.cc:1403] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.014s
I20251215 20:52:17.473898 1837 ts_tablet_manager.cc:1434] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20251215 20:52:17.475322 1837 tablet_bootstrap.cc:492] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.475154 1835 raft_consensus.cc:359] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.475915 1835 raft_consensus.cc:385] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.476251 1835 raft_consensus.cc:740] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.477035 1835 consensus_queue.cc:260] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.477964 1794 raft_consensus.cc:2468] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:17.479233 1687 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.479554 1835 ts_tablet_manager.cc:1434] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:52:17.480306 2025 raft_consensus.cc:2804] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.480659 1835 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.481029 2025 raft_consensus.cc:697] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:17.481878 1837 tablet_bootstrap.cc:654] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.481829 2025 consensus_queue.cc:237] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.488247 1835 tablet_bootstrap.cc:654] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.505530 1541 catalog_manager.cc:5654] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:17.516489 1836 tablet_bootstrap.cc:492] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.516964 1836 ts_tablet_manager.cc:1403] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.018s
I20251215 20:52:17.519479 1836 raft_consensus.cc:359] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.520098 1836 raft_consensus.cc:385] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.520390 1836 raft_consensus.cc:740] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.520949 1836 consensus_queue.cc:260] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.523059 1836 ts_tablet_manager.cc:1434] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:17.524667 1836 tablet_bootstrap.cc:492] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:17.528474 1835 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.528970 1835 ts_tablet_manager.cc:1403] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.026s
I20251215 20:52:17.537665 1836 tablet_bootstrap.cc:654] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.540247 1835 raft_consensus.cc:359] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.540970 1835 raft_consensus.cc:385] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.541234 1835 raft_consensus.cc:740] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.541839 1835 consensus_queue.cc:260] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.547972 1835 ts_tablet_manager.cc:1434] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20251215 20:52:17.548882 1835 tablet_bootstrap.cc:492] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.560839 1837 tablet_bootstrap.cc:492] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:17.560082 1646 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.565362 1905 consensus_queue.cc:1048] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.573052 1836 tablet_bootstrap.cc:492] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.573585 1836 ts_tablet_manager.cc:1403] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.049s user 0.018s sys 0.011s
I20251215 20:52:17.561332 1837 ts_tablet_manager.cc:1403] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.086s user 0.030s sys 0.040s
I20251215 20:52:17.574420 1835 tablet_bootstrap.cc:654] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.576467 1836 raft_consensus.cc:359] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.577214 1836 raft_consensus.cc:385] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.577474 1836 raft_consensus.cc:740] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.578104 1836 consensus_queue.cc:260] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.582619 1842 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.583729 1842 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.586550 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:17.589380 1760 leader_election.cc:343] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.588773 1837 raft_consensus.cc:359] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.590535 1837 raft_consensus.cc:385] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.590795 1837 raft_consensus.cc:740] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.591440 1837 consensus_queue.cc:260] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.592597 1836 ts_tablet_manager.cc:1434] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20251215 20:52:17.593451 1836 tablet_bootstrap.cc:492] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
W20251215 20:52:17.596832 1592 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:52:17.599027 1842 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:17.600069 1837 ts_tablet_manager.cc:1434] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.026s user 0.004s sys 0.002s
I20251215 20:52:17.600958 1837 tablet_bootstrap.cc:492] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.601703 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:17.602751 1761 leader_election.cc:343] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.603171 1761 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.605876 1842 raft_consensus.cc:2749] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.611471 1835 tablet_bootstrap.cc:492] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.611901 1835 ts_tablet_manager.cc:1403] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.063s user 0.011s sys 0.012s
I20251215 20:52:17.614001 1836 tablet_bootstrap.cc:654] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.614266 1835 raft_consensus.cc:359] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.614907 1835 raft_consensus.cc:385] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.615181 1835 raft_consensus.cc:740] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.615747 1835 consensus_queue.cc:260] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.617251 1794 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.622704 1835 ts_tablet_manager.cc:1434] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20251215 20:52:17.623657 1835 tablet_bootstrap.cc:492] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.631991 1920 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.632607 1920 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.634721 1920 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.635775 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.636433 1795 raft_consensus.cc:2468] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:17.637778 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.639539 1837 tablet_bootstrap.cc:654] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:17.644641 1686 leader_election.cc:343] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.645452 1904 consensus_queue.cc:1048] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.645594 1687 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.646389 2025 raft_consensus.cc:2804] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:17.646715 2025 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:17.647024 2025 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.653492 1835 tablet_bootstrap.cc:654] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.664368 2025 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.666002 1836 tablet_bootstrap.cc:492] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.666450 1836 ts_tablet_manager.cc:1403] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.073s user 0.018s sys 0.009s
I20251215 20:52:17.666630 1644 raft_consensus.cc:3060] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.667730 1842 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.667009 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:17.668265 1842 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:17.669344 1686 leader_election.cc:343] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.670078 1842 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:17.671408 1836 raft_consensus.cc:359] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.672062 1836 raft_consensus.cc:385] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.672425 1836 raft_consensus.cc:740] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.673326 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.675721 1718 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:17.675825 1836 consensus_queue.cc:260] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.676187 1862 consensus_queue.cc:1048] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.676838 1761 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:17.673925 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.677773 2002 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:17.677964 1836 ts_tablet_manager.cc:1434] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20251215 20:52:17.678195 2002 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:52:17.678351 1760 leader_election.cc:343] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.678601 2002 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.680038 1836 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:17.687747 1862 consensus_queue.cc:1048] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:17.689282 1905 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.689791 1905 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.692848 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.693519 1718 raft_consensus.cc:2468] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:17.694832 1612 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:17.695621 1904 raft_consensus.cc:2804] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:17.695993 1904 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:17.696391 1904 raft_consensus.cc:3060] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.700567 1920 consensus_queue.cc:1048] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.701447 1905 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.702564 1904 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.703045 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.703737 1792 raft_consensus.cc:2468] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:17.705093 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:17.705615 1718 raft_consensus.cc:3060] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.688022 2025 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.700526 2002 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.708187 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:17.717003 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:17.717203 1904 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.709170 1835 tablet_bootstrap.cc:492] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.717590 1792 raft_consensus.cc:3060] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.717625 1794 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.718955 1835 ts_tablet_manager.cc:1403] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.095s user 0.015s sys 0.000s
I20251215 20:52:17.720139 1718 raft_consensus.cc:2468] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:17.721351 1612 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:17.721725 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:17.723369 1837 tablet_bootstrap.cc:492] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
W20251215 20:52:17.723506 1760 leader_election.cc:343] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.723798 1837 ts_tablet_manager.cc:1403] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.123s user 0.009s sys 0.014s
I20251215 20:52:17.723613 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:17.724260 1720 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.724380 1792 raft_consensus.cc:2468] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:17.724663 1904 raft_consensus.cc:2804] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.728003 1904 raft_consensus.cc:697] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:17.728885 1904 consensus_queue.cc:237] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.721284 1835 raft_consensus.cc:359] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.729911 1835 raft_consensus.cc:385] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.730198 1835 raft_consensus.cc:740] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.730767 1835 consensus_queue.cc:260] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.732335 1720 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:17.732538 1906 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.733021 1906 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.734336 1837 raft_consensus.cc:359] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.734797 1906 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:17.734978 1837 raft_consensus.cc:385] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.735292 1837 raft_consensus.cc:740] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.735586 2002 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:17.737664 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:17.739282 1760 leader_election.cc:343] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.741266 1836 tablet_bootstrap.cc:654] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.741411 1761 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.741856 1835 ts_tablet_manager.cc:1434] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20251215 20:52:17.744663 1904 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.748436 1842 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.748270 1904 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.749825 1842 raft_consensus.cc:697] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:17.750695 1842 consensus_queue.cc:237] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.751016 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.735880 1837 consensus_queue.cc:260] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.751338 2026 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.756532 1837 ts_tablet_manager.cc:1434] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.032s user 0.008s sys 0.000s
I20251215 20:52:17.756080 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.756400 2026 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.757349 1835 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.757341 1837 tablet_bootstrap.cc:492] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.758412 1612 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.760334 1843 raft_consensus.cc:2749] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.761094 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.757413 1904 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:17.762224 1686 leader_election.cc:343] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.760394 2026 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.757710 1794 raft_consensus.cc:2468] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:17.768534 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.771268 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.773743 1687 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:17.775262 1687 leader_election.cc:343] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.775702 1687 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.777887 2013 raft_consensus.cc:2804] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.778693 1921 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.781697 1835 tablet_bootstrap.cc:654] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.774050 1920 consensus_queue.cc:1048] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20251215 20:52:17.788612 2026 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.789065 2026 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.788975 1541 catalog_manager.cc:5654] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:17.792001 2026 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.793121 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:17.794250 1686 leader_election.cc:343] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.785183 1837 tablet_bootstrap.cc:654] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:17.796345 1761 leader_election.cc:343] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.797423 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.801505 2026 consensus_queue.cc:1048] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.801465 1761 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.803930 1842 raft_consensus.cc:2749] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:17.811460 1687 leader_election.cc:343] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.812042 1687 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.813206 2026 raft_consensus.cc:2749] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.820221 1920 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.820501 2025 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.820726 1920 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.820971 2025 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.822753 1920 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.824340 2025 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:17.830370 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.831758 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.832680 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.835158 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.835628 1837 tablet_bootstrap.cc:492] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:17.836086 1837 ts_tablet_manager.cc:1403] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.079s user 0.017s sys 0.000s
I20251215 20:52:17.823668 2013 raft_consensus.cc:697] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:17.837559 2013 consensus_queue.cc:237] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.837916 1543 catalog_manager.cc:5654] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:17.838657 1837 raft_consensus.cc:359] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.839234 1837 raft_consensus.cc:385] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.839443 1837 raft_consensus.cc:740] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.839946 1837 consensus_queue.cc:260] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:17.842005 1686 leader_election.cc:343] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:17.842687 1686 leader_election.cc:343] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.843806 1836 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.844323 1836 ts_tablet_manager.cc:1403] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.164s user 0.020s sys 0.010s
I20251215 20:52:17.847077 1835 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.847489 1835 ts_tablet_manager.cc:1403] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.090s user 0.010s sys 0.003s
I20251215 20:52:17.848167 1837 ts_tablet_manager.cc:1434] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20251215 20:52:17.849902 1836 raft_consensus.cc:359] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.850795 1835 raft_consensus.cc:359] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.850530 1836 raft_consensus.cc:385] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.852959 1836 raft_consensus.cc:740] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.851404 1835 raft_consensus.cc:385] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.853555 1836 consensus_queue.cc:260] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.854847 1835 raft_consensus.cc:740] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.852779 1837 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:17.855564 1835 consensus_queue.cc:260] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.861847 1836 ts_tablet_manager.cc:1434] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
W20251215 20:52:17.852420 1687 leader_election.cc:343] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.862254 1687 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.862758 1836 tablet_bootstrap.cc:492] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:17.863987 1920 raft_consensus.cc:2749] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.864015 1835 ts_tablet_manager.cc:1434] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.016s user 0.003s sys 0.002s
I20251215 20:52:17.865187 1835 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.873237 1544 catalog_manager.cc:5654] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:17.884603 1837 tablet_bootstrap.cc:654] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.891064 1836 tablet_bootstrap.cc:654] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.894791 1835 tablet_bootstrap.cc:654] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:17.898609 1687 leader_election.cc:343] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.899176 1687 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.901729 1836 tablet_bootstrap.cc:492] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:17.902245 1836 ts_tablet_manager.cc:1403] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.008s
I20251215 20:52:17.902172 1920 raft_consensus.cc:2749] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.904868 1836 raft_consensus.cc:359] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.905553 1836 raft_consensus.cc:385] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.905802 1836 raft_consensus.cc:740] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.905932 1920 consensus_queue.cc:1048] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:17.906728 1835 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.907199 1835 ts_tablet_manager.cc:1403] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.042s user 0.016s sys 0.006s
I20251215 20:52:17.911062 1836 consensus_queue.cc:260] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.914971 1835 raft_consensus.cc:359] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.915629 1835 raft_consensus.cc:385] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.915978 1835 raft_consensus.cc:740] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.915916 2069 consensus_queue.cc:1048] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:17.916841 1835 consensus_queue.cc:260] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.919867 1842 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.920346 1842 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.921983 1835 ts_tablet_manager.cc:1434] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20251215 20:52:17.922088 1842 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:17.922884 1835 tablet_bootstrap.cc:492] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.924542 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:17.925877 1836 ts_tablet_manager.cc:1434] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.023s user 0.007s sys 0.001s
W20251215 20:52:17.925964 1760 leader_election.cc:343] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.927644 1836 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:17.932832 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.933531 1718 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:17.934419 1761 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.934924 1835 tablet_bootstrap.cc:654] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.935745 1842 raft_consensus.cc:2804] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:17.936118 1842 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:17.936477 1842 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.941603 1904 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:17.942072 1904 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.942943 1842 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.943938 1904 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:17.945128 1686 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:17.945510 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:17.945837 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:17.947012 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:17.947651 1793 raft_consensus.cc:2393] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:17.948340 1835 tablet_bootstrap.cc:492] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.948768 1835 ts_tablet_manager.cc:1403] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.026s user 0.014s sys 0.000s
I20251215 20:52:17.949079 1842 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:17.949833 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:17.949980 1760 leader_election.cc:343] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:17.950368 1718 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.951685 1835 raft_consensus.cc:359] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.952283 1835 raft_consensus.cc:385] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.952579 1835 raft_consensus.cc:740] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.953122 1612 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:17.954485 1835 consensus_queue.cc:260] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.954452 1904 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.957222 1835 ts_tablet_manager.cc:1434] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251215 20:52:17.958096 1835 tablet_bootstrap.cc:492] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.963641 1835 tablet_bootstrap.cc:654] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.963976 1837 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:17.966715 1718 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:17.968083 1836 tablet_bootstrap.cc:654] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.968379 1837 ts_tablet_manager.cc:1403] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.119s user 0.012s sys 0.013s
I20251215 20:52:17.968338 1904 raft_consensus.cc:2749] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:17.969973 1761 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:17.971802 1837 raft_consensus.cc:359] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.972510 1837 raft_consensus.cc:385] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.972776 1837 raft_consensus.cc:740] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.973369 1837 consensus_queue.cc:260] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.973723 2002 raft_consensus.cc:2804] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:17.974313 1835 tablet_bootstrap.cc:492] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.974756 1835 ts_tablet_manager.cc:1403] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.007s
I20251215 20:52:17.974221 2002 raft_consensus.cc:697] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:17.975720 2002 consensus_queue.cc:237] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.977010 1835 raft_consensus.cc:359] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.977597 1835 raft_consensus.cc:385] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.977831 1835 raft_consensus.cc:740] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.978380 1835 consensus_queue.cc:260] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.980806 1835 ts_tablet_manager.cc:1434] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:52:17.981638 1835 tablet_bootstrap.cc:492] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:17.987486 1835 tablet_bootstrap.cc:654] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:17.988631 1541 catalog_manager.cc:5654] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:17.992079 1835 tablet_bootstrap.cc:492] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:17.992545 1835 ts_tablet_manager.cc:1403] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20251215 20:52:17.994833 1835 raft_consensus.cc:359] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.995481 1835 raft_consensus.cc:385] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:17.995663 1646 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:17.995725 1835 raft_consensus.cc:740] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:17.996518 1835 consensus_queue.cc:260] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:17.998688 1835 ts_tablet_manager.cc:1434] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20251215 20:52:17.999536 1835 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.001730 1837 ts_tablet_manager.cc:1434] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.033s user 0.004s sys 0.000s
I20251215 20:52:18.005383 1835 tablet_bootstrap.cc:654] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.007437 1837 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:18.014163 1843 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.014678 1843 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.016674 1843 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.017832 1835 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.018266 1835 ts_tablet_manager.cc:1403] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.008s
I20251215 20:52:18.019322 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.020130 1718 raft_consensus.cc:2393] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:18.022245 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.023382 1836 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.023819 1836 ts_tablet_manager.cc:1403] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.096s user 0.006s sys 0.003s
I20251215 20:52:18.023969 1612 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:18.025033 1837 tablet_bootstrap.cc:654] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.025182 1904 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.026124 1836 raft_consensus.cc:359] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.026773 1836 raft_consensus.cc:385] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.027024 1836 raft_consensus.cc:740] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.028502 1835 raft_consensus.cc:359] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.029119 1835 raft_consensus.cc:385] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.029361 1835 raft_consensus.cc:740] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.029896 1835 consensus_queue.cc:260] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.031405 1835 ts_tablet_manager.cc:1434] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20251215 20:52:18.032181 1835 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.032790 1904 raft_consensus.cc:2749] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.027623 1836 consensus_queue.cc:260] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.036803 2013 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.037178 2013 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.038072 1835 tablet_bootstrap.cc:654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.038882 2013 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.039934 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.040248 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:18.041141 1687 leader_election.cc:343] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:18.041613 1686 leader_election.cc:343] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.042061 1686 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.042719 2026 raft_consensus.cc:2749] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.044497 1836 ts_tablet_manager.cc:1434] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.020s user 0.002s sys 0.005s
I20251215 20:52:18.046479 1835 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.046828 1835 ts_tablet_manager.cc:1403] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.003s
I20251215 20:52:18.049183 1835 raft_consensus.cc:359] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.049813 1835 raft_consensus.cc:385] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.049927 1836 tablet_bootstrap.cc:492] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.050066 1835 raft_consensus.cc:740] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.050730 1835 consensus_queue.cc:260] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.052785 1835 ts_tablet_manager.cc:1434] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251215 20:52:18.053629 1835 tablet_bootstrap.cc:492] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.059948 1835 tablet_bootstrap.cc:654] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.063161 1836 tablet_bootstrap.cc:654] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.067106 1837 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.067562 1837 ts_tablet_manager.cc:1403] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.060s user 0.012s sys 0.000s
I20251215 20:52:18.069789 1837 raft_consensus.cc:359] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.070426 1837 raft_consensus.cc:385] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.070677 1837 raft_consensus.cc:740] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.071360 1837 consensus_queue.cc:260] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.073431 1837 ts_tablet_manager.cc:1434] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:52:18.074242 1837 tablet_bootstrap.cc:492] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:18.079411 1836 tablet_bootstrap.cc:492] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.079854 1836 ts_tablet_manager.cc:1403] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.002s
I20251215 20:52:18.079913 1837 tablet_bootstrap.cc:654] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.082474 1836 raft_consensus.cc:359] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.083071 1836 raft_consensus.cc:385] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.083352 1836 raft_consensus.cc:740] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.084456 1836 consensus_queue.cc:260] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.086642 1836 ts_tablet_manager.cc:1434] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:18.087459 1836 tablet_bootstrap.cc:492] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.092077 1835 tablet_bootstrap.cc:492] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.092525 1835 ts_tablet_manager.cc:1403] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.039s user 0.022s sys 0.013s
I20251215 20:52:18.093132 1836 tablet_bootstrap.cc:654] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.094810 1835 raft_consensus.cc:359] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.095461 1835 raft_consensus.cc:385] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.095721 1835 raft_consensus.cc:740] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.096357 1835 consensus_queue.cc:260] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.098381 1835 ts_tablet_manager.cc:1434] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:18.099378 1835 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.104655 1835 tablet_bootstrap.cc:654] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.110879 1836 tablet_bootstrap.cc:492] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.111963 1836 ts_tablet_manager.cc:1403] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.001s
I20251215 20:52:18.114322 1836 raft_consensus.cc:359] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.114964 1836 raft_consensus.cc:385] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.115204 1836 raft_consensus.cc:740] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.115751 1836 consensus_queue.cc:260] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.117715 1836 ts_tablet_manager.cc:1434] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:52:18.118108 1842 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.118525 1836 tablet_bootstrap.cc:492] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.118535 1842 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.121313 1842 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:18.122761 1835 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.123173 1835 ts_tablet_manager.cc:1403] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.000s
I20251215 20:52:18.122761 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.123836 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:18.125139 1760 leader_election.cc:343] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.125447 1835 raft_consensus.cc:359] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:18.126009 1761 leader_election.cc:343] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.126140 1835 raft_consensus.cc:385] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.126509 1835 raft_consensus.cc:740] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.126453 1761 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:18.127249 2002 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.127164 1835 consensus_queue.cc:260] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.129222 1835 ts_tablet_manager.cc:1434] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:52:18.132118 1835 tablet_bootstrap.cc:492] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.133641 1837 tablet_bootstrap.cc:492] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.134100 1837 ts_tablet_manager.cc:1403] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.060s user 0.026s sys 0.018s
I20251215 20:52:18.134258 1836 tablet_bootstrap.cc:654] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.136756 1837 raft_consensus.cc:359] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.137567 1837 raft_consensus.cc:385] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.137893 1837 raft_consensus.cc:740] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.137095 1842 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.138403 1837 consensus_queue.cc:260] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.138677 1842 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.137310 1835 tablet_bootstrap.cc:654] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.140453 1837 ts_tablet_manager.cc:1434] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20251215 20:52:18.142287 1836 tablet_bootstrap.cc:492] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.145427 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.145301 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.146111 1718 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
W20251215 20:52:18.147042 1760 leader_election.cc:343] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.147392 1837 tablet_bootstrap.cc:492] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:18.147557 1842 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:18.147814 1843 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.148224 1843 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.150022 1843 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.150992 1842 consensus_queue.cc:1048] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:18.151121 1761 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.153771 2013 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.154138 1837 tablet_bootstrap.cc:654] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.154630 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.153762 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.153878 1904 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.154268 2013 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.155462 1793 raft_consensus.cc:2468] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:18.156112 1904 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.158051 1904 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.158638 1842 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.159046 1842 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.159353 1842 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.160964 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.162097 2013 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.162819 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.164390 1612 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:18.164839 1842 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.165786 1612 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:18.167085 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:18.168783 1843 raft_consensus.cc:2804] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.170431 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:18.170538 1760 leader_election.cc:343] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.170986 1793 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:18.171339 1905 raft_consensus.cc:2749] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.171299 2002 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.172058 1687 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:18.172353 1837 tablet_bootstrap.cc:492] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.155360 1718 raft_consensus.cc:2468] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:18.172865 1837 ts_tablet_manager.cc:1403] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.026s user 0.014s sys 0.003s
I20251215 20:52:18.169129 1843 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.173365 1843 raft_consensus.cc:3060] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.172394 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.174335 2003 consensus_queue.cc:1048] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:52:18.174746 1686 leader_election.cc:343] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.175145 1837 raft_consensus.cc:359] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.175752 1837 raft_consensus.cc:385] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.176028 1837 raft_consensus.cc:740] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.176734 2013 raft_consensus.cc:2804] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.176592 1837 consensus_queue.cc:260] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.177090 2013 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.172099 2002 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.177446 2013 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.178440 1837 ts_tablet_manager.cc:1434] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20251215 20:52:18.179392 1837 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:18.182384 2026 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.182811 2026 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.183513 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.184597 2026 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:18.184759 1760 leader_election.cc:343] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.185142 1837 tablet_bootstrap.cc:654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.185971 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.186558 1644 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:18.187875 2002 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:18.179374 1843 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.188735 2069 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.189366 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.188161 1686 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:18.189951 1718 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:18.190478 1843 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.189182 2069 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.190512 2026 raft_consensus.cc:2804] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.192229 1842 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:18.192499 2069 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.193397 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.194518 2026 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.194917 2026 raft_consensus.cc:3060] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.195446 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.196122 1792 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:18.197028 1761 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.197860 1842 raft_consensus.cc:2804] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.198176 1842 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.198465 1842 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.198518 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:18.199162 1718 raft_consensus.cc:3060] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:52:18.200577 1686 leader_election.cc:343] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.202514 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.203069 1793 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:18.203768 1842 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.203948 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:18.204629 1719 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.206355 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:18.207563 1760 leader_election.cc:343] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.209884 1687 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.211812 1920 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.211887 1842 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:18.212541 1920 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.212936 1920 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.229548 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:18.230242 1721 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.234557 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:18.235210 1795 raft_consensus.cc:3060] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.243104 1843 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.243673 1843 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.245699 1843 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.249711 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.250936 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:18.251426 1612 leader_election.cc:343] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.251543 1716 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:18.253140 1612 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:18.254547 1843 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.254884 1843 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.255191 1843 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.258466 2026 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.269445 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:18.270052 1644 raft_consensus.cc:3060] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.276492 1904 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:18.278757 1644 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:18.280093 1686 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:18.281023 2025 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.281719 1921 raft_consensus.cc:2804] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:18.281559 2025 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.282244 1921 raft_consensus.cc:697] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:18.283088 1921 consensus_queue.cc:237] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.284029 2025 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.289373 1905 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:18.297636 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.298350 1794 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:18.263356 1843 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.311390 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:18.312041 1716 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.315884 1718 raft_consensus.cc:2468] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:18.310806 1687 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:18.340858 2069 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.341277 2069 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.341676 2069 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.318660 1920 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.347573 2025 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.347949 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:18.348114 2025 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.349741 1920 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.351329 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:18.350251 2025 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.351873 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.351878 1790 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.354671 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:18.356603 1686 leader_election.cc:343] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.329218 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:18.359683 1612 leader_election.cc:343] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:18.361514 1687 leader_election.cc:343] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.360138 1790 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:18.330663 2026 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.144243 1836 ts_tablet_manager.cc:1403] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.003s
I20251215 20:52:18.375650 1836 raft_consensus.cc:359] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.376583 1836 raft_consensus.cc:385] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.376906 1836 raft_consensus.cc:740] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.378129 1836 consensus_queue.cc:260] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.337606 1795 raft_consensus.cc:2468] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:18.379855 1612 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:18.380769 1905 raft_consensus.cc:2804] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:18.381209 1905 raft_consensus.cc:697] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:18.382051 1905 consensus_queue.cc:237] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.338578 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:18.388581 1760 consensus_peers.cc:597] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:18.323338 1716 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:18.348572 1791 raft_consensus.cc:3060] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.401592 1791 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:18.324613 1843 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.325985 1921 consensus_queue.cc:1048] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:18.357635 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.227610 1719 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:18.269847 1721 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:18.406251 1612 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:18.407280 1687 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.407480 1843 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:18.408434 1843 raft_consensus.cc:697] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:18.409016 1761 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.409462 1843 consensus_queue.cc:237] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.410640 2104 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:18.323764 2013 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.411096 2104 raft_consensus.cc:697] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:18.411883 2104 consensus_queue.cc:237] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:18.416371 1686 leader_election.cc:343] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:18.422237 1686 leader_election.cc:343] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.427294 1686 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.419616 2026 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:18.419697 2025 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.432181 2025 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.434757 2025 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.435753 1543 catalog_manager.cc:5654] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:18.445668 2002 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.446225 2002 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.449079 2107 raft_consensus.cc:2749] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.449023 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:18.451371 1760 leader_election.cc:343] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.451767 1921 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.451864 2026 raft_consensus.cc:697] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:18.452209 1921 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.452716 2002 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:18.453301 2026 consensus_queue.cc:237] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.454197 1921 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.454108 1541 catalog_manager.cc:5654] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:18.459975 1835 tablet_bootstrap.cc:492] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.460564 1835 ts_tablet_manager.cc:1403] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.329s user 0.071s sys 0.098s
I20251215 20:52:18.463440 1835 raft_consensus.cc:359] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.464213 1835 raft_consensus.cc:385] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.464856 1835 raft_consensus.cc:740] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.465653 1835 consensus_queue.cc:260] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.467928 2107 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.468456 2107 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.470499 2107 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.478001 1837 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.478467 1837 ts_tablet_manager.cc:1403] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.299s user 0.140s sys 0.124s
I20251215 20:52:18.478834 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:18.425885 2069 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.417944 2013 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.409999 1761 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.481974 1837 raft_consensus.cc:359] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:18.482348 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 72408.9us
I20251215 20:52:18.482622 1837 raft_consensus.cc:385] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.482900 1837 raft_consensus.cc:740] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.483357 1842 raft_consensus.cc:2804] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:18.483788 1842 raft_consensus.cc:697] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:18.483564 1837 consensus_queue.cc:260] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.484472 1842 consensus_queue.cc:237] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.485612 1837 ts_tablet_manager.cc:1434] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20251215 20:52:18.487210 1837 tablet_bootstrap.cc:492] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:18.491858 1544 catalog_manager.cc:5654] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:18.494254 1837 tablet_bootstrap.cc:654] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.430675 1836 ts_tablet_manager.cc:1434] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.057s user 0.005s sys 0.001s
I20251215 20:52:18.481213 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.497588 1836 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.498432 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:18.500159 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.505184 1791 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.511722 1835 ts_tablet_manager.cc:1434] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.051s user 0.003s sys 0.003s
I20251215 20:52:18.509889 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.520076 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.520171 1921 consensus_queue.cc:1048] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:52:18.520592 1687 leader_election.cc:343] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:18.521240 1687 leader_election.cc:343] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.522266 1835 tablet_bootstrap.cc:492] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.527750 1645 raft_consensus.cc:3060] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.527733 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.527727 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.532927 1719 raft_consensus.cc:2468] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:18.535676 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:18.536827 1687 leader_election.cc:343] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.537969 1761 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.538705 1543 catalog_manager.cc:5654] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:18.546088 1791 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:18.547176 1842 raft_consensus.cc:2804] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:18.547464 1842 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:18.548499 1842 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.549575 1837 tablet_bootstrap.cc:492] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.549909 1837 ts_tablet_manager.cc:1403] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.063s user 0.020s sys 0.008s
I20251215 20:52:18.542122 2069 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.551113 1687 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:18.552816 2107 raft_consensus.cc:2804] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:18.553298 2107 raft_consensus.cc:697] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:18.554108 2107 consensus_queue.cc:237] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.555902 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:18.557883 1686 leader_election.cc:343] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:18.559415 1686 leader_election.cc:343] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.558987 1544 catalog_manager.cc:5654] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:18.559847 1686 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.560868 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:18.561450 1791 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.569437 2002 consensus_queue.cc:1048] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:18.574216 1791 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
W20251215 20:52:18.574779 1686 leader_election.cc:343] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.575277 1686 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.575881 1835 tablet_bootstrap.cc:654] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.577039 1687 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:18.586315 1842 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.571925 2069 raft_consensus.cc:2749] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.596226 1842 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:18.580482 1920 raft_consensus.cc:2749] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.599229 1544 catalog_manager.cc:5654] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:18.604772 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:18.606606 1836 tablet_bootstrap.cc:654] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.600432 2069 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
W20251215 20:52:18.599720 1686 leader_election.cc:343] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.609272 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:18.610502 1719 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.611310 1837 raft_consensus.cc:359] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.611930 1837 raft_consensus.cc:385] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.607098 2069 raft_consensus.cc:697] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:18.612164 1837 raft_consensus.cc:740] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.619783 1837 consensus_queue.cc:260] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.620429 1646 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.629114 2069 consensus_queue.cc:237] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.616997 1686 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:18.631783 2013 raft_consensus.cc:2749] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.642640 1837 ts_tablet_manager.cc:1434] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.093s user 0.004s sys 0.002s
I20251215 20:52:18.643543 1837 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
W20251215 20:52:18.638484 1686 leader_election.cc:343] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:18.654671 1541 catalog_manager.cc:5654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:18.655637 1719 raft_consensus.cc:2468] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:18.661589 1646 raft_consensus.cc:2468] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:18.663888 1761 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:18.664837 1842 raft_consensus.cc:2804] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:18.665339 1842 raft_consensus.cc:697] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:18.666071 1842 consensus_queue.cc:237] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.708189 1837 tablet_bootstrap.cc:654] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.710258 1836 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.712550 1544 catalog_manager.cc:5654] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:18.714058 1836 ts_tablet_manager.cc:1403] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.217s user 0.014s sys 0.015s
I20251215 20:52:18.719782 1836 raft_consensus.cc:359] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.720428 1836 raft_consensus.cc:385] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.720695 1836 raft_consensus.cc:740] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.721278 1836 consensus_queue.cc:260] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.722777 1836 ts_tablet_manager.cc:1434] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20251215 20:52:18.723563 1836 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.728645 1835 tablet_bootstrap.cc:492] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.729086 1835 ts_tablet_manager.cc:1403] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.216s user 0.009s sys 0.047s
I20251215 20:52:18.735772 1835 raft_consensus.cc:359] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.736424 1835 raft_consensus.cc:385] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.736699 1835 raft_consensus.cc:740] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.754997 1836 tablet_bootstrap.cc:654] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.762682 1835 consensus_queue.cc:260] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.770032 1835 ts_tablet_manager.cc:1434] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.041s user 0.008s sys 0.000s
I20251215 20:52:18.770974 1835 tablet_bootstrap.cc:492] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.774080 1862 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:18.777407 1835 tablet_bootstrap.cc:654] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.778443 1836 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.778920 1836 ts_tablet_manager.cc:1403] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.056s user 0.013s sys 0.002s
I20251215 20:52:18.781342 1836 raft_consensus.cc:359] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.781984 1836 raft_consensus.cc:385] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.782239 1836 raft_consensus.cc:740] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.783077 1837 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.783547 1837 ts_tablet_manager.cc:1403] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.140s user 0.008s sys 0.004s
I20251215 20:52:18.786108 1837 raft_consensus.cc:359] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.786254 1836 consensus_queue.cc:260] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.786783 1837 raft_consensus.cc:385] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.787057 1837 raft_consensus.cc:740] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.787636 1837 consensus_queue.cc:260] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.788406 1836 ts_tablet_manager.cc:1434] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20251215 20:52:18.789428 1836 tablet_bootstrap.cc:492] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.790268 1837 ts_tablet_manager.cc:1434] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20251215 20:52:18.792758 1837 tablet_bootstrap.cc:492] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:18.796175 1836 tablet_bootstrap.cc:654] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.798311 1920 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:18.800577 1837 tablet_bootstrap.cc:654] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.808054 1835 tablet_bootstrap.cc:492] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.808175 1836 tablet_bootstrap.cc:492] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.808590 1835 ts_tablet_manager.cc:1403] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.038s user 0.017s sys 0.000s
I20251215 20:52:18.808765 1836 ts_tablet_manager.cc:1403] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.020s user 0.017s sys 0.000s
I20251215 20:52:18.813247 1835 raft_consensus.cc:359] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.813948 1835 raft_consensus.cc:385] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.813434 1543 catalog_manager.cc:5654] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:18.814224 1835 raft_consensus.cc:740] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.814921 1835 consensus_queue.cc:260] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.816952 1835 ts_tablet_manager.cc:1434] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:52:18.817826 1835 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.823302 1837 tablet_bootstrap.cc:492] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.823786 1837 ts_tablet_manager.cc:1403] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.002s
I20251215 20:52:18.826486 1837 raft_consensus.cc:359] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.827153 1837 raft_consensus.cc:385] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.827426 1837 raft_consensus.cc:740] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.828549 1837 consensus_queue.cc:260] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.831126 1837 ts_tablet_manager.cc:1434] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20251215 20:52:18.832019 1837 tablet_bootstrap.cc:492] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:18.829088 1836 raft_consensus.cc:359] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.832894 1836 raft_consensus.cc:385] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.833185 1836 raft_consensus.cc:740] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.833854 1836 consensus_queue.cc:260] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.835945 1836 ts_tablet_manager.cc:1434] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.027s user 0.003s sys 0.001s
I20251215 20:52:18.836792 1836 tablet_bootstrap.cc:492] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.845547 1835 tablet_bootstrap.cc:654] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.855947 1836 tablet_bootstrap.cc:654] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.856251 1905 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:18.856570 1592 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:52:18.856853 1905 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.861747 1905 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:18.865147 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.872467 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:18.873916 1837 tablet_bootstrap.cc:654] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.873438 1795 raft_consensus.cc:2393] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:18.877094 1612 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:18.878813 2103 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.883203 1836 tablet_bootstrap.cc:492] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.883682 1835 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.883733 1836 ts_tablet_manager.cc:1403] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.012s
I20251215 20:52:18.884267 1835 ts_tablet_manager.cc:1403] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.067s user 0.029s sys 0.004s
W20251215 20:52:18.885030 1612 consensus_peers.cc:597] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:18.887115 1836 raft_consensus.cc:359] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.887281 1835 raft_consensus.cc:359] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.888139 1835 raft_consensus.cc:385] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.888520 1835 raft_consensus.cc:740] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.889266 1835 consensus_queue.cc:260] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:18.890198 1760 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:18.891707 1835 ts_tablet_manager.cc:1434] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20251215 20:52:18.887857 1836 raft_consensus.cc:385] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.892514 1837 tablet_bootstrap.cc:492] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.892517 1836 raft_consensus.cc:740] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.893155 1837 ts_tablet_manager.cc:1403] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.061s user 0.011s sys 0.006s
I20251215 20:52:18.893255 1835 tablet_bootstrap.cc:492] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.896279 1837 raft_consensus.cc:359] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.896998 1837 raft_consensus.cc:385] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.897281 1837 raft_consensus.cc:740] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.897862 1837 consensus_queue.cc:260] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.899895 1837 ts_tablet_manager.cc:1434] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:52:18.900235 1835 tablet_bootstrap.cc:654] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.893342 1836 consensus_queue.cc:260] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.901044 1837 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:18.902441 1836 ts_tablet_manager.cc:1434] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.018s user 0.003s sys 0.002s
I20251215 20:52:18.903254 1836 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.908464 1836 tablet_bootstrap.cc:654] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.918478 1835 tablet_bootstrap.cc:492] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:18.918939 1835 ts_tablet_manager.cc:1403] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.007s
I20251215 20:52:18.921330 1835 raft_consensus.cc:359] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.922024 1835 raft_consensus.cc:385] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.922297 1835 raft_consensus.cc:740] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.923066 1835 consensus_queue.cc:260] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.924501 1836 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:18.924960 1836 ts_tablet_manager.cc:1403] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.005s
I20251215 20:52:18.924547 1837 tablet_bootstrap.cc:654] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.929374 1836 raft_consensus.cc:359] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.930142 1836 raft_consensus.cc:385] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.930444 1836 raft_consensus.cc:740] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.931115 1836 consensus_queue.cc:260] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:18.932142 1686 consensus_peers.cc:597] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:18.932904 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:18.934674 1646 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:18.936067 1835 ts_tablet_manager.cc:1434] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.017s user 0.005s sys 0.002s
I20251215 20:52:18.938642 1836 ts_tablet_manager.cc:1434] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.013s user 0.004s sys 0.001s
I20251215 20:52:18.938381 1843 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:18.939667 1836 tablet_bootstrap.cc:492] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:18.936976 1835 tablet_bootstrap.cc:492] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:18.935232 2103 raft_consensus.cc:2749] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:18.961249 2003 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.961757 1836 tablet_bootstrap.cc:654] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.961757 2003 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.966881 1835 tablet_bootstrap.cc:654] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:18.988781 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:18.989599 1721 raft_consensus.cc:2393] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 1: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:18.977365 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:18.991029 2069 consensus_queue.cc:1048] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:18.992278 2103 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:18.994634 2104 consensus_queue.cc:1048] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 20:52:18.995002 1837 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:18.985461 2003 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:18.995477 1837 ts_tablet_manager.cc:1403] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.095s user 0.009s sys 0.004s
I20251215 20:52:18.997294 1760 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:18.997926 1837 raft_consensus.cc:359] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.998493 2003 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:18.998667 1837 raft_consensus.cc:385] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:18.998970 1837 raft_consensus.cc:740] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:18.998980 2003 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:18.999630 1837 consensus_queue.cc:260] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.001075 2003 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.001706 1837 ts_tablet_manager.cc:1434] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251215 20:52:19.002592 1837 tablet_bootstrap.cc:492] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:19.002301 1835 tablet_bootstrap.cc:492] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:19.005530 1835 ts_tablet_manager.cc:1403] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.069s user 0.013s sys 0.011s
I20251215 20:52:19.006808 2003 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.008167 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.008941 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.009521 1721 raft_consensus.cc:2468] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
W20251215 20:52:19.009559 1760 leader_election.cc:343] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.012135 1835 raft_consensus.cc:359] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.012383 2104 consensus_queue.cc:1048] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.012908 1835 raft_consensus.cc:385] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.016975 1835 raft_consensus.cc:740] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.017591 1835 consensus_queue.cc:260] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.021905 1835 ts_tablet_manager.cc:1434] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20251215 20:52:19.022931 1835 tablet_bootstrap.cc:492] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:19.028004 2003 raft_consensus.cc:2749] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:19.031211 2107 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.031716 2107 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.033579 2107 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.034382 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.035159 1835 tablet_bootstrap.cc:654] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:19.036777 1686 leader_election.cc:343] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.039134 1761 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.041682 1835 tablet_bootstrap.cc:492] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:19.057993 1835 ts_tablet_manager.cc:1403] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.005s
I20251215 20:52:19.058286 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.060262 1837 tablet_bootstrap.cc:654] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.060573 1835 raft_consensus.cc:359] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.061196 1835 raft_consensus.cc:385] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.061137 2003 raft_consensus.cc:2804] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.061533 1835 raft_consensus.cc:740] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.061815 2003 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.062209 2003 raft_consensus.cc:3060] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.052549 2140 consensus_queue.cc:1048] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.055657 1836 tablet_bootstrap.cc:492] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:19.063516 1836 ts_tablet_manager.cc:1403] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.124s user 0.012s sys 0.010s
I20251215 20:52:19.056416 1921 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.066628 1921 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.068781 1921 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.070024 1836 raft_consensus.cc:359] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.070808 1836 raft_consensus.cc:385] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.071075 1836 raft_consensus.cc:740] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.071699 1836 consensus_queue.cc:260] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.074970 1836 ts_tablet_manager.cc:1434] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20251215 20:52:19.076042 1835 consensus_queue.cc:260] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.078270 2003 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.082644 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.078516 1835 ts_tablet_manager.cc:1434] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
W20251215 20:52:19.084344 1687 leader_election.cc:343] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.090724 1791 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:19.091140 1687 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.091876 1921 raft_consensus.cc:2749] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:19.094017 1835 tablet_bootstrap.cc:492] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:19.095271 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:19.096725 1760 leader_election.cc:343] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.102099 2003 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.102443 1836 tablet_bootstrap.cc:492] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:19.109931 1836 tablet_bootstrap.cc:654] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.087472 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.124218 1842 consensus_queue.cc:1048] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:52:19.137089 1686 leader_election.cc:343] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:19.142596 1686 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:19.152261 1687 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.154021 2140 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.154573 2140 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.157482 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.158171 1716 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:19.161062 1612 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:19.162901 2003 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.163300 2003 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.164543 2103 raft_consensus.cc:2804] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.164918 2103 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.165239 2103 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.166416 1837 tablet_bootstrap.cc:492] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:19.166847 1837 ts_tablet_manager.cc:1403] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.164s user 0.045s sys 0.061s
I20251215 20:52:19.167320 2104 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.167761 2104 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.170958 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.172192 1836 tablet_bootstrap.cc:492] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:19.172623 1836 ts_tablet_manager.cc:1403] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.070s user 0.007s sys 0.003s
I20251215 20:52:19.176501 2025 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.176884 2025 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.170971 2104 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.177194 2025 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.177177 1837 raft_consensus.cc:359] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.177930 1837 raft_consensus.cc:385] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.178179 1837 raft_consensus.cc:740] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.180037 1837 consensus_queue.cc:260] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.179502 2069 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.180781 2069 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.182292 1837 ts_tablet_manager.cc:1434] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20251215 20:52:19.183616 2103 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.184577 1837 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:19.184370 1921 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.185050 1646 raft_consensus.cc:2393] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 1: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:19.186295 2003 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.186494 1836 raft_consensus.cc:359] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.187515 1836 raft_consensus.cc:385] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.187793 1836 raft_consensus.cc:740] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.187870 2069 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.188375 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.188485 1836 consensus_queue.cc:260] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.189505 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:19.189642 1686 leader_election.cc:343] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.187013 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.190052 1718 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.190371 1644 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:19.190115 2103 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.191751 1760 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:19.193115 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:19.193233 2104 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.193936 1795 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.194612 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:19.195127 1716 raft_consensus.cc:3060] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.193677 2104 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.196789 2104 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.192343 1836 ts_tablet_manager.cc:1434] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20251215 20:52:19.198611 1836 tablet_bootstrap.cc:492] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:19.203420 1795 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:19.208056 1835 tablet_bootstrap.cc:654] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.208608 1716 raft_consensus.cc:2468] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:19.213284 1718 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:19.221392 1612 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:19.222138 2103 raft_consensus.cc:2804] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.222574 2103 raft_consensus.cc:697] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:19.223381 2103 consensus_queue.cc:237] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.225000 2013 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.211336 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.213831 2140 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.214591 2025 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.218582 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.218899 1837 tablet_bootstrap.cc:654] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.233395 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.234210 1906 consensus_queue.cc:1048] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.244554 1721 raft_consensus.cc:2393] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 1: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:19.244644 1792 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:19.224009 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.245374 1790 raft_consensus.cc:2376] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1. Re-sending same reply.
I20251215 20:52:19.236135 2104 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.247251 2025 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.271293 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:19.272588 1686 leader_election.cc:343] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:19.297876 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 46056us
I20251215 20:52:19.251822 1719 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:19.309269 2104 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.315587 1837 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:19.316006 1837 ts_tablet_manager.cc:1403] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.132s user 0.017s sys 0.017s
I20251215 20:52:19.334121 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:19.334625 1646 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.339030 1646 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:19.342283 1835 tablet_bootstrap.cc:492] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:19.342917 1835 ts_tablet_manager.cc:1403] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.249s user 0.011s sys 0.011s
I20251215 20:52:19.344630 2103 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.345311 1836 tablet_bootstrap.cc:654] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.345155 2103 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.346905 2103 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.347729 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.347769 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:19.352937 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 51363.7us
I20251215 20:52:19.353623 1687 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.354758 1862 raft_consensus.cc:2804] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.355094 1862 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.355404 1862 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.356786 1544 catalog_manager.cc:5654] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:19.361960 1862 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.365072 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:19.366192 1612 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:19.366384 1686 leader_election.cc:343] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.368589 1761 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.369424 1862 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.369666 1761 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:19.370182 2001 raft_consensus.cc:2804] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.370664 2001 raft_consensus.cc:697] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:19.373953 2002 raft_consensus.cc:2749] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:19.372491 2103 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:19.377857 1836 tablet_bootstrap.cc:492] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:19.378302 1836 ts_tablet_manager.cc:1403] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.180s user 0.011s sys 0.007s
I20251215 20:52:19.378207 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:19.379128 1837 raft_consensus.cc:359] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.381583 1837 raft_consensus.cc:385] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.381803 1837 raft_consensus.cc:740] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.382614 2025 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.380518 1795 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.378209 1760 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:19.384090 1835 raft_consensus.cc:359] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.384599 2103 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.384799 1835 raft_consensus.cc:385] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.385119 1835 raft_consensus.cc:740] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.383042 2025 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.385810 2002 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.386305 2002 raft_consensus.cc:697] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:19.386860 2025 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.387174 2002 consensus_queue.cc:237] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.388832 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.388818 2001 consensus_queue.cc:237] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.389891 1837 consensus_queue.cc:260] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:19.391567 1686 leader_election.cc:343] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.392405 2103 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.393278 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:19.393887 1716 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.394461 2103 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.395205 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.398921 1835 consensus_queue.cc:260] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.411425 1836 raft_consensus.cc:359] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.412251 1836 raft_consensus.cc:385] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.412561 1836 raft_consensus.cc:740] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.413177 1836 consensus_queue.cc:260] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.417052 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:19.417652 1790 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.406916 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.418648 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.419237 1789 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:19.419910 1837 ts_tablet_manager.cc:1434] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.104s user 0.003s sys 0.004s
I20251215 20:52:19.420884 1837 tablet_bootstrap.cc:492] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:19.422238 1644 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.422603 1835 ts_tablet_manager.cc:1434] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.079s user 0.006s sys 0.001s
I20251215 20:52:19.423553 1687 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.435901 1612 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:19.440143 1836 ts_tablet_manager.cc:1434] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.061s user 0.003s sys 0.003s
I20251215 20:52:19.441319 1836 tablet_bootstrap.cc:492] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:19.434669 1921 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.439791 1906 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.439615 1862 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.437988 2013 consensus_queue.cc:1048] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20251215 20:52:19.446396 1921 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.457213 1835 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:19.456326 1921 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.453963 1906 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.465406 1906 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.466802 1837 tablet_bootstrap.cc:654] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.471047 1716 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:19.461742 1795 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:19.473423 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.474107 1718 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:19.476006 1687 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.454119 1862 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.479362 1761 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:19.482420 1645 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.481503 2025 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.484601 2025 raft_consensus.cc:697] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:19.485394 2025 consensus_queue.cc:237] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.488677 2164 raft_consensus.cc:2804] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.491185 2103 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.491665 2103 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.493510 2103 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.481470 1790 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:19.495834 1862 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.497344 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:19.500638 1686 leader_election.cc:343] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.489095 2164 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.506021 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.509065 1687 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.507328 1921 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.511552 1921 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.505535 2164 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.520556 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.520782 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:19.521368 1921 raft_consensus.cc:2804] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.521337 1790 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.523125 1921 raft_consensus.cc:697] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:19.523944 1921 consensus_queue.cc:237] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:19.524763 1687 leader_election.cc:343] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.525179 1687 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.528159 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:19.531445 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.529523 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.537912 1836 tablet_bootstrap.cc:654] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
W20251215 20:52:19.540993 1686 leader_election.cc:343] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.516616 1862 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.543205 1612 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:19.543936 1843 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:19.529532 2107 raft_consensus.cc:2749] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:19.529744 1760 leader_election.cc:343] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.549607 1837 tablet_bootstrap.cc:492] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:19.549832 1835 tablet_bootstrap.cc:654] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.550060 1837 ts_tablet_manager.cc:1403] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.129s user 0.015s sys 0.015s
I20251215 20:52:19.545720 1862 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.560171 1790 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:19.561556 1687 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.562147 1862 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.562359 2013 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.562851 2013 raft_consensus.cc:697] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:19.570967 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.570119 2013 consensus_queue.cc:237] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.571645 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:19.573223 1687 leader_election.cc:343] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.573751 2164 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.577508 2140 raft_consensus.cc:2749] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:19.578658 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:19.587179 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:19.587935 1686 leader_election.cc:343] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.588485 1686 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.587803 1718 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.581475 2164 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.592039 1862 raft_consensus.cc:2749] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:19.607133 2167 log.cc:927] Time spent T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.081s user 0.000s sys 0.002s
I20251215 20:52:19.610672 1541 catalog_manager.cc:5654] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:19.611666 1718 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:19.612573 1761 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:19.619786 1760 leader_election.cc:343] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.621838 2001 raft_consensus.cc:2804] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.622345 2001 raft_consensus.cc:697] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:19.623113 2001 consensus_queue.cc:237] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.624574 1837 raft_consensus.cc:359] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.626685 1837 raft_consensus.cc:385] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.626971 1837 raft_consensus.cc:740] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.628949 1837 consensus_queue.cc:260] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.632045 1837 ts_tablet_manager.cc:1434] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.082s user 0.008s sys 0.005s
I20251215 20:52:19.633917 1837 tablet_bootstrap.cc:492] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:19.634565 1835 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:19.637089 1836 tablet_bootstrap.cc:492] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:19.663601 1835 ts_tablet_manager.cc:1403] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.206s user 0.018s sys 0.012s
I20251215 20:52:19.663560 1836 ts_tablet_manager.cc:1403] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.222s user 0.015s sys 0.012s
I20251215 20:52:19.693408 1836 raft_consensus.cc:359] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.694135 1836 raft_consensus.cc:385] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.694389 1836 raft_consensus.cc:740] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.694953 1836 consensus_queue.cc:260] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.697031 1836 ts_tablet_manager.cc:1434] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.032s user 0.005s sys 0.000s
I20251215 20:52:19.697650 1836 tablet_bootstrap.cc:492] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:19.691087 1835 raft_consensus.cc:359] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.698125 1835 raft_consensus.cc:385] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.698365 1835 raft_consensus.cc:740] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.705708 1835 consensus_queue.cc:260] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.717058 1835 ts_tablet_manager.cc:1434] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.052s user 0.001s sys 0.004s
I20251215 20:52:19.717929 1835 tablet_bootstrap.cc:492] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:19.722857 1836 tablet_bootstrap.cc:654] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.734176 1541 catalog_manager.cc:5654] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:19.736147 1541 catalog_manager.cc:5654] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:19.737905 1837 tablet_bootstrap.cc:654] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.737668 1541 catalog_manager.cc:5654] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:19.740979 1835 tablet_bootstrap.cc:654] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.745841 1836 tablet_bootstrap.cc:492] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:19.746420 1836 ts_tablet_manager.cc:1403] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.006s
I20251215 20:52:19.749150 1836 raft_consensus.cc:359] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.749953 1836 raft_consensus.cc:385] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.750270 1836 raft_consensus.cc:740] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.751118 1836 consensus_queue.cc:260] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.753401 1836 ts_tablet_manager.cc:1434] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:52:19.753788 1835 tablet_bootstrap.cc:492] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:19.754197 2001 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.754626 1836 tablet_bootstrap.cc:492] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:19.754689 2001 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.754158 1543 catalog_manager.cc:5654] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:19.756990 2001 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.758747 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.758297 1543 catalog_manager.cc:5654] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
W20251215 20:52:19.759856 1760 leader_election.cc:343] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.758219 1835 ts_tablet_manager.cc:1403] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.040s user 0.012s sys 0.005s
I20251215 20:52:19.760926 1836 tablet_bootstrap.cc:654] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.761264 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.766052 1721 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:19.767089 1761 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.768049 2001 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.762846 1835 raft_consensus.cc:359] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.768460 2001 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.768606 1835 raft_consensus.cc:385] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.768826 2001 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.768945 1835 raft_consensus.cc:740] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.769676 1835 consensus_queue.cc:260] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.771879 1835 ts_tablet_manager.cc:1434] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20251215 20:52:19.772959 1835 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:19.775652 2001 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.778152 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:19.779100 2001 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:19.779146 1760 leader_election.cc:343] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.780601 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:19.781136 1721 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.782157 1837 tablet_bootstrap.cc:492] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:19.782588 1837 ts_tablet_manager.cc:1403] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.149s user 0.014s sys 0.007s
I20251215 20:52:19.782959 2069 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.783391 2069 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.783780 1835 tablet_bootstrap.cc:654] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.785019 2140 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.785377 2069 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.784951 1837 raft_consensus.cc:359] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.786274 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:19.786404 1837 raft_consensus.cc:385] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.786520 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.786774 1837 raft_consensus.cc:740] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
W20251215 20:52:19.787289 1686 leader_election.cc:343] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.787359 1837 consensus_queue.cc:260] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:19.787777 1687 leader_election.cc:343] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.788218 1687 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.788887 2069 raft_consensus.cc:2749] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:19.797648 1721 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:19.798038 2140 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.799425 1761 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.800670 1837 ts_tablet_manager.cc:1434] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20251215 20:52:19.801551 1837 tablet_bootstrap.cc:492] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:19.801858 1836 tablet_bootstrap.cc:492] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:19.802358 1836 ts_tablet_manager.cc:1403] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.048s user 0.010s sys 0.004s
I20251215 20:52:19.804685 1836 raft_consensus.cc:359] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.807153 1836 raft_consensus.cc:385] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.807847 1836 raft_consensus.cc:740] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.808866 1836 consensus_queue.cc:260] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.810859 2164 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.811865 2164 raft_consensus.cc:697] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:19.812651 2164 consensus_queue.cc:237] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.813119 1836 ts_tablet_manager.cc:1434] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.010s user 0.004s sys 0.002s
I20251215 20:52:19.815392 1836 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:19.822491 1835 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:19.823015 1835 ts_tablet_manager.cc:1403] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.018s
I20251215 20:52:19.823639 1836 tablet_bootstrap.cc:654] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.825562 1835 raft_consensus.cc:359] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.826417 1835 raft_consensus.cc:385] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.826743 1835 raft_consensus.cc:740] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.827445 1835 consensus_queue.cc:260] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.829145 1835 ts_tablet_manager.cc:1434] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:52:19.806876 1837 tablet_bootstrap.cc:654] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.841630 1835 tablet_bootstrap.cc:492] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:19.852733 1837 tablet_bootstrap.cc:492] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:19.853226 1837 ts_tablet_manager.cc:1403] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.052s user 0.008s sys 0.008s
I20251215 20:52:19.855688 1837 raft_consensus.cc:359] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.855919 1842 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:19.856489 1837 raft_consensus.cc:385] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.856832 1837 raft_consensus.cc:740] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.857441 1837 consensus_queue.cc:260] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.859608 1837 ts_tablet_manager.cc:1434] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:19.860576 1837 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:19.866255 1837 tablet_bootstrap.cc:654] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.867353 2164 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.867889 2164 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.870910 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:19.872339 1760 leader_election.cc:343] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.874430 2164 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.875847 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:19.876683 1716 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:19.877862 1761 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.878654 1842 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:19.878998 1842 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:19.879329 1842 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.886503 1842 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.896201 1843 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.896668 1843 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.898252 1843 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.899806 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:19.902848 1760 consensus_peers.cc:597] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:19.903252 1543 catalog_manager.cc:5654] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:19.892561 1837 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:19.907367 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:19.907758 1837 ts_tablet_manager.cc:1403] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.047s user 0.017s sys 0.003s
I20251215 20:52:19.908969 1612 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:19.910212 1837 raft_consensus.cc:359] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.910861 1837 raft_consensus.cc:385] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.911099 1837 raft_consensus.cc:740] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.911701 1837 consensus_queue.cc:260] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.913815 1837 ts_tablet_manager.cc:1434] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:52:19.914659 1837 tablet_bootstrap.cc:492] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:19.914853 2153 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:19.917140 1843 raft_consensus.cc:2749] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:19.918345 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:19.919277 1644 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:52:19.919464 1760 leader_election.cc:343] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.919914 1837 tablet_bootstrap.cc:654] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.894132 1836 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:19.920620 1836 ts_tablet_manager.cc:1403] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.105s user 0.025s sys 0.007s
I20251215 20:52:19.895988 1835 tablet_bootstrap.cc:654] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.928262 1836 raft_consensus.cc:359] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.928944 1836 raft_consensus.cc:385] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.930269 1842 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:19.929201 1836 raft_consensus.cc:740] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.930461 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:19.931139 1721 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:19.931320 1836 consensus_queue.cc:260] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.934108 1836 ts_tablet_manager.cc:1434] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.013s user 0.004s sys 0.003s
I20251215 20:52:19.934948 1836 tablet_bootstrap.cc:492] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:19.935672 2001 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.937441 1721 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:19.939855 1837 tablet_bootstrap.cc:492] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:19.940279 1837 ts_tablet_manager.cc:1403] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.002s
I20251215 20:52:19.942948 1761 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:19.943681 1836 tablet_bootstrap.cc:654] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:19.944422 1842 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:19.945080 1842 raft_consensus.cc:697] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:19.945859 1842 consensus_queue.cc:237] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:19.946143 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:19.945183 1837 raft_consensus.cc:359] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.946915 1837 raft_consensus.cc:385] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:19.947190 1837 raft_consensus.cc:740] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:19.948632 1837 consensus_queue.cc:260] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.950706 1837 ts_tablet_manager.cc:1434] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20251215 20:52:19.951547 1837 tablet_bootstrap.cc:492] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:19.958600 2025 consensus_queue.cc:1048] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:19.961643 2025 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.962113 2025 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:19.964305 2025 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.965973 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:19.979220 1686 leader_election.cc:343] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:19.996479 1843 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:19.996991 1843 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.009263 1843 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:19.982409 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.011672 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.010457 2069 consensus_queue.cc:1048] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20251215 20:52:20.013717 1687 leader_election.cc:343] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.014161 1687 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.018631 1862 raft_consensus.cc:2749] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:20.022943 1837 tablet_bootstrap.cc:654] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.016170 2103 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.028141 2103 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.031809 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.032636 1788 raft_consensus.cc:2393] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:20.034392 1612 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:20.038378 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.039155 1721 raft_consensus.cc:2393] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:20.041481 1835 tablet_bootstrap.cc:492] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:20.041925 1835 ts_tablet_manager.cc:1403] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.209s user 0.018s sys 0.052s
I20251215 20:52:20.036585 1905 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.046273 1836 tablet_bootstrap.cc:492] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:20.046736 1836 ts_tablet_manager.cc:1403] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.112s user 0.005s sys 0.011s
I20251215 20:52:20.036161 1645 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.042364 2103 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.056425 1835 raft_consensus.cc:359] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.057341 1835 raft_consensus.cc:385] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.057607 1835 raft_consensus.cc:740] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.058192 1835 consensus_queue.cc:260] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.059566 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.060199 1835 ts_tablet_manager.cc:1434] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20251215 20:52:20.064602 2153 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.066323 1612 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:20.066869 2153 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.083942 1835 tablet_bootstrap.cc:492] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:20.083551 1836 raft_consensus.cc:359] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.084328 1836 raft_consensus.cc:385] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.084604 1836 raft_consensus.cc:740] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.085189 1836 consensus_queue.cc:260] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.087450 1544 catalog_manager.cc:5654] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:20.067337 2140 raft_consensus.cc:2749] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:20.103232 1592 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20251215 20:52:20.106829 1686 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:20.106261 2164 consensus_queue.cc:1048] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:20.114068 1837 tablet_bootstrap.cc:492] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.114558 1837 ts_tablet_manager.cc:1403] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.163s user 0.014s sys 0.016s
I20251215 20:52:20.120903 1905 raft_consensus.cc:2749] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:20.122634 1836 ts_tablet_manager.cc:1434] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.076s user 0.004s sys 0.002s
I20251215 20:52:20.123462 1836 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:20.124920 2025 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.125444 2164 consensus_queue.cc:1048] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:20.125385 2025 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.131456 2153 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:20.147037 2025 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.150651 2103 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.151048 2103 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.151613 1905 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.152714 2103 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.152822 1905 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.157251 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.163061 1905 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.167335 1837 raft_consensus.cc:359] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.168040 1837 raft_consensus.cc:385] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.168363 1837 raft_consensus.cc:740] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.168923 1837 consensus_queue.cc:260] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.169939 1836 tablet_bootstrap.cc:654] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.206473 1640 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.209244 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:20.210222 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:20.211705 1641 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.212805 1837 ts_tablet_manager.cc:1434] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.098s user 0.003s sys 0.004s
I20251215 20:52:20.215090 1837 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.215972 1835 tablet_bootstrap.cc:654] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.216059 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.160636 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.221418 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.228094 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.220201 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:20.231870 1760 leader_election.cc:343] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.244697 2025 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.250353 2025 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.256615 1612 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:20.266983 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:20.274817 1612 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:20.276654 2141 raft_consensus.cc:2749] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:20.262943 1687 leader_election.cc:343] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:52:20.289404 1686 leader_election.cc:343] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.293288 2107 consensus_queue.cc:1048] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:20.301462 2025 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.302742 1686 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.306493 2140 raft_consensus.cc:2749] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:20.311118 1761 leader_election.cc:343] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.311655 1761 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:20.312465 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:20.313074 2013 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:20.314373 2153 raft_consensus.cc:2749] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:52:20.315622 1686 leader_election.cc:343] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.336421 2204 consensus_queue.cc:1048] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 20:52:20.342247 1837 tablet_bootstrap.cc:654] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.354638 1906 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.355278 1906 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.357831 1835 tablet_bootstrap.cc:492] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:20.369549 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:20.372519 1760 leader_election.cc:343] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.373133 1906 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:20.383426 1835 ts_tablet_manager.cc:1403] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.300s user 0.028s sys 0.033s
I20251215 20:52:20.383100 1906 consensus_queue.cc:1048] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20251215 20:52:20.389683 2104 consensus_queue.cc:1048] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:20.393081 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.394904 1836 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:20.407047 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.407863 1716 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
W20251215 20:52:20.409811 1687 leader_election.cc:343] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.410171 1687 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.409472 1835 raft_consensus.cc:359] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.412175 1835 raft_consensus.cc:385] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.412494 1835 raft_consensus.cc:740] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.412623 2013 raft_consensus.cc:2749] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:20.413146 1835 consensus_queue.cc:260] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.414886 1835 ts_tablet_manager.cc:1434] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.031s user 0.004s sys 0.000s
I20251215 20:52:20.415256 1836 ts_tablet_manager.cc:1403] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.292s user 0.026s sys 0.005s
I20251215 20:52:20.422297 1837 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.423832 1835 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Bootstrap starting.
I20251215 20:52:20.422327 1836 raft_consensus.cc:359] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.425513 1836 raft_consensus.cc:385] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.425843 1836 raft_consensus.cc:740] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.422857 1837 ts_tablet_manager.cc:1403] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.208s user 0.026s sys 0.008s
I20251215 20:52:20.429338 1837 raft_consensus.cc:359] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.430069 1837 raft_consensus.cc:385] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.430377 1837 raft_consensus.cc:740] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.431133 1837 consensus_queue.cc:260] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.433826 1837 ts_tablet_manager.cc:1434] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251215 20:52:20.432137 1836 consensus_queue.cc:260] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.435204 1836 ts_tablet_manager.cc:1434] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.020s user 0.002s sys 0.003s
I20251215 20:52:20.436353 1837 tablet_bootstrap.cc:492] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.437636 1836 tablet_bootstrap.cc:492] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:20.445070 1761 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.445864 1906 raft_consensus.cc:2804] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:20.446285 1906 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:20.446609 1906 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:52:20.454974 1760 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:20.460397 1906 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.463300 1836 tablet_bootstrap.cc:654] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.470822 1837 tablet_bootstrap.cc:654] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.477552 1906 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:20.479916 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:20.486136 1760 leader_election.cc:343] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.487694 1842 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.488215 1842 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.490028 1842 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:20.491889 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:20.496863 1760 leader_election.cc:343] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.498224 1843 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.498639 1843 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.500469 1843 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.502576 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.502861 1835 tablet_bootstrap.cc:654] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.504848 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.505124 1836 tablet_bootstrap.cc:492] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:20.505654 1836 ts_tablet_manager.cc:1403] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.068s user 0.018s sys 0.002s
I20251215 20:52:20.506202 1612 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:20.509778 2103 raft_consensus.cc:2749] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:20.510448 1640 raft_consensus.cc:3060] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.513487 1836 raft_consensus.cc:359] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.514175 1836 raft_consensus.cc:385] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.514463 1836 raft_consensus.cc:740] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.515091 1836 consensus_queue.cc:260] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.517688 1836 ts_tablet_manager.cc:1434] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:52:20.519268 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:20.519901 1718 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.524900 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.525499 1719 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
I20251215 20:52:20.527294 1761 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.527925 1842 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:20.528219 1842 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:20.528579 1842 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.536159 1842 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.537323 1837 tablet_bootstrap.cc:492] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.537784 1837 ts_tablet_manager.cc:1403] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.102s user 0.007s sys 0.014s
I20251215 20:52:20.538636 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:20.539762 1718 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
W20251215 20:52:20.539855 1760 leader_election.cc:343] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.540184 1837 raft_consensus.cc:359] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.540830 1837 raft_consensus.cc:385] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.541095 1837 raft_consensus.cc:740] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.541281 1842 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:20.541880 1837 consensus_queue.cc:260] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.518853 1836 tablet_bootstrap.cc:492] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:20.544127 1837 ts_tablet_manager.cc:1434] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:52:20.544087 1761 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.545226 1837 tablet_bootstrap.cc:492] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.545173 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:20.552693 1718 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.555850 1842 raft_consensus.cc:2804] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:20.556532 1842 raft_consensus.cc:697] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:20.557291 1842 consensus_queue.cc:237] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.561255 1639 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.567878 1836 tablet_bootstrap.cc:654] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.555819 1837 tablet_bootstrap.cc:654] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.571094 1843 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.574553 1718 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:20.576260 1843 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.581789 1843 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.607703 2164 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.608310 2164 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.610845 2164 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:20.645641 1835 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: No bootstrap required, opened a new log
I20251215 20:52:20.646153 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.648075 1761 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.650204 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:20.651497 1612 leader_election.cc:343] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.652051 2164 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:20.653184 2164 raft_consensus.cc:697] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
W20251215 20:52:20.653765 1761 leader_election.cc:343] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.654420 1837 tablet_bootstrap.cc:492] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.654007 2164 consensus_queue.cc:237] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.654858 1837 ts_tablet_manager.cc:1403] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.110s user 0.008s sys 0.001s
I20251215 20:52:20.656000 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:20.657051 1837 raft_consensus.cc:359] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.657582 1837 raft_consensus.cc:385] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.657850 1837 raft_consensus.cc:740] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.658401 1837 consensus_queue.cc:260] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:20.659042 1760 leader_election.cc:343] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.659479 1760 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:20.660976 1837 ts_tablet_manager.cc:1434] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20251215 20:52:20.661887 1837 tablet_bootstrap.cc:492] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.662482 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.663101 1718 raft_consensus.cc:2468] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:20.668229 1835 ts_tablet_manager.cc:1403] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent bootstrapping tablet: real 0.245s user 0.011s sys 0.001s
I20251215 20:52:20.676131 1837 tablet_bootstrap.cc:654] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.676450 1906 raft_consensus.cc:2749] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:20.678689 1835 raft_consensus.cc:359] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.679376 1835 raft_consensus.cc:385] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.679630 1835 raft_consensus.cc:740] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.680207 1835 consensus_queue.cc:260] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.683254 1612 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:20.684522 2140 raft_consensus.cc:2804] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:20.684818 2140 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:20.685019 2140 raft_consensus.cc:3060] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.688896 1541 catalog_manager.cc:5654] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:20.690390 2140 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.692111 1835 ts_tablet_manager.cc:1434] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent starting tablet: real 0.018s user 0.004s sys 0.001s
I20251215 20:52:20.692459 2140 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.694175 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:20.695384 1612 leader_election.cc:343] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.696483 1837 tablet_bootstrap.cc:492] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.696955 1837 ts_tablet_manager.cc:1403] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.035s user 0.012s sys 0.003s
I20251215 20:52:20.699841 1836 tablet_bootstrap.cc:492] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:20.700363 1836 ts_tablet_manager.cc:1403] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.182s user 0.012s sys 0.000s
I20251215 20:52:20.701328 1837 raft_consensus.cc:359] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.701957 1837 raft_consensus.cc:385] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.703632 1837 raft_consensus.cc:740] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.703747 1836 raft_consensus.cc:359] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.704245 1837 consensus_queue.cc:260] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.705734 1836 raft_consensus.cc:385] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.706076 1836 raft_consensus.cc:740] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.706506 1837 ts_tablet_manager.cc:1434] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20251215 20:52:20.706677 1836 consensus_queue.cc:260] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.707427 1837 tablet_bootstrap.cc:492] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.708873 1836 ts_tablet_manager.cc:1434] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.008s user 0.004s sys 0.001s
I20251215 20:52:20.718279 1836 tablet_bootstrap.cc:492] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:20.722707 1837 tablet_bootstrap.cc:654] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.724889 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:20.725428 1720 raft_consensus.cc:3060] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.725941 1836 tablet_bootstrap.cc:654] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.738287 1720 raft_consensus.cc:2468] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:20.739293 1612 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:20.740265 2140 raft_consensus.cc:2804] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:20.740747 2140 raft_consensus.cc:697] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:20.741504 2140 consensus_queue.cc:237] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.742290 1836 tablet_bootstrap.cc:492] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:20.742761 1836 ts_tablet_manager.cc:1403] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.025s user 0.014s sys 0.005s
I20251215 20:52:20.745843 2103 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.746295 2103 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.746414 1836 raft_consensus.cc:359] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.747047 1836 raft_consensus.cc:385] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.747304 1836 raft_consensus.cc:740] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.748153 2103 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.747872 1836 consensus_queue.cc:260] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.750716 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.751034 1836 ts_tablet_manager.cc:1434] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.008s user 0.002s sys 0.003s
I20251215 20:52:20.751832 1836 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: Bootstrap starting.
I20251215 20:52:20.756307 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.757732 1836 tablet_bootstrap.cc:654] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.757791 1612 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:20.759554 1905 raft_consensus.cc:2749] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:20.766119 1541 catalog_manager.cc:5654] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:20.771906 1836 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: No bootstrap required, opened a new log
I20251215 20:52:20.772382 1836 ts_tablet_manager.cc:1403] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.005s
I20251215 20:52:20.774925 1836 raft_consensus.cc:359] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.775556 1836 raft_consensus.cc:385] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.775799 1836 raft_consensus.cc:740] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.780249 1837 tablet_bootstrap.cc:492] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.780763 1837 ts_tablet_manager.cc:1403] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.002s
I20251215 20:52:20.782996 1837 raft_consensus.cc:359] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.783438 1837 raft_consensus.cc:385] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.783648 1837 raft_consensus.cc:740] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.784164 1837 consensus_queue.cc:260] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.785701 1837 ts_tablet_manager.cc:1434] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:52:20.777966 1836 consensus_queue.cc:260] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.787931 1836 ts_tablet_manager.cc:1434] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: Time spent starting tablet: real 0.015s user 0.004s sys 0.001s
I20251215 20:52:20.788739 1837 tablet_bootstrap.cc:492] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.789492 1543 catalog_manager.cc:5654] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:20.794375 1837 tablet_bootstrap.cc:654] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.799163 1837 tablet_bootstrap.cc:492] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.799597 1837 ts_tablet_manager.cc:1403] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20251215 20:52:20.801823 2164 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.802016 1837 raft_consensus.cc:359] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.802311 2164 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.802700 1837 raft_consensus.cc:385] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.802981 1837 raft_consensus.cc:740] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.804139 2164 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:20.803988 1837 consensus_queue.cc:260] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.805869 1837 ts_tablet_manager.cc:1434] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:52:20.806700 1837 tablet_bootstrap.cc:492] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.806588 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:20.806936 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.807550 1720 raft_consensus.cc:2468] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 0.
W20251215 20:52:20.807883 1760 leader_election.cc:343] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.809154 1761 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.810536 2164 raft_consensus.cc:2804] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:20.810885 2164 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:20.811205 2164 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.811966 1837 tablet_bootstrap.cc:654] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.817720 2164 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.820063 2164 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:20.821712 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:20.822278 1720 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.823546 1837 tablet_bootstrap.cc:492] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.823992 1837 ts_tablet_manager.cc:1403] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20251215 20:52:20.828262 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:20.828980 1837 raft_consensus.cc:359] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.829909 1837 raft_consensus.cc:385] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.829016 1720 raft_consensus.cc:2468] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
W20251215 20:52:20.830003 1760 leader_election.cc:343] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:52:20.830178 1837 raft_consensus.cc:740] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.830742 1761 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:20.831040 1837 consensus_queue.cc:260] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.831660 2164 raft_consensus.cc:2804] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:20.832031 2204 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.832592 2164 raft_consensus.cc:697] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:20.832742 2204 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.833166 1837 ts_tablet_manager.cc:1434] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.009s user 0.007s sys 0.001s
I20251215 20:52:20.833424 2164 consensus_queue.cc:237] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.834153 1837 tablet_bootstrap.cc:492] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.835438 2204 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.835700 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.836325 1791 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:20.837499 1687 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:20.837672 2107 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.838091 2107 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.839217 1862 raft_consensus.cc:2804] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:20.839542 1862 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:20.839811 1862 raft_consensus.cc:3060] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.839859 2107 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.841776 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:20.842360 1640 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:20.842590 1837 tablet_bootstrap.cc:654] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.843420 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:20.843969 1646 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:20.845170 1686 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:20.845918 2206 raft_consensus.cc:2804] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:20.846096 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.846583 2206 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:20.846669 1791 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:20.846940 2206 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.850500 1862 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.856555 1862 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.858193 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:20.858708 1791 raft_consensus.cc:3060] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.859975 2206 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.861254 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:20.862462 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:20.862952 1646 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.863036 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:20.863580 1788 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.865216 1791 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:20.866876 1837 tablet_bootstrap.cc:492] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.867414 1837 ts_tablet_manager.cc:1403] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.033s user 0.015s sys 0.004s
I20251215 20:52:20.869311 1687 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:20.869493 1639 raft_consensus.cc:3060] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.870294 1837 raft_consensus.cc:359] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.871069 1837 raft_consensus.cc:385] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.871376 1837 raft_consensus.cc:740] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.872083 1837 consensus_queue.cc:260] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.872718 1788 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:20.873924 1687 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:20.874558 1837 ts_tablet_manager.cc:1434] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251215 20:52:20.874642 2204 raft_consensus.cc:2804] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:20.875209 2204 raft_consensus.cc:697] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:20.875317 2107 raft_consensus.cc:2804] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:20.875911 1837 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.876093 2204 consensus_queue.cc:237] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.876567 2107 raft_consensus.cc:697] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:20.877359 2107 consensus_queue.cc:237] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.879583 2206 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.883785 1837 tablet_bootstrap.cc:654] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.898592 1543 catalog_manager.cc:5654] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:20.900636 1837 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.901240 1837 ts_tablet_manager.cc:1403] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.026s user 0.016s sys 0.002s
I20251215 20:52:20.904608 1837 raft_consensus.cc:359] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.905480 1837 raft_consensus.cc:385] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.905792 1837 raft_consensus.cc:740] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.906519 1837 consensus_queue.cc:260] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.869002 1646 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:20.908737 1837 ts_tablet_manager.cc:1434] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251215 20:52:20.909683 1837 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de: Bootstrap starting.
I20251215 20:52:20.911274 1639 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:20.919078 1837 tablet_bootstrap.cc:654] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de: Neither blocks nor log segments found. Creating new log.
I20251215 20:52:20.924229 1837 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de: No bootstrap required, opened a new log
I20251215 20:52:20.924664 1837 ts_tablet_manager.cc:1403] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.003s
I20251215 20:52:20.926316 1837 raft_consensus.cc:359] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.926769 1837 raft_consensus.cc:385] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:52:20.927014 1837 raft_consensus.cc:740] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Initialized, Role: FOLLOWER
I20251215 20:52:20.927484 1837 consensus_queue.cc:260] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.929695 1837 ts_tablet_manager.cc:1434] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20251215 20:52:20.931500 1543 catalog_manager.cc:5654] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:20.933035 1543 catalog_manager.cc:5654] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:20.935176 2107 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.936218 2107 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.937965 1905 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.938387 1905 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.940155 1905 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.941941 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:20.942054 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.942495 1646 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:20.942711 1718 raft_consensus.cc:2393] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 1: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:20.943418 1686 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:20.944103 2204 raft_consensus.cc:2804] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:20.944381 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.944809 2107 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.945758 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.946331 1788 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 0.
I20251215 20:52:20.944442 2204 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:20.947103 2204 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.952877 1612 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:20.953642 1905 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.958221 2204 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.959920 2140 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:20.960186 2204 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.960409 2140 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.961071 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:20.961627 1639 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.962252 2140 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.963023 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:20.962353 1905 raft_consensus.cc:2749] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:20.963907 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:20.964063 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:20.964469 1791 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:20.964632 1718 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 0.
I20251215 20:52:20.965466 1612 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:20.963550 1788 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.966617 1905 raft_consensus.cc:2804] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:52:20.966962 1905 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:20.967272 1905 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.969507 1639 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:20.970618 1686 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:20.971328 2204 raft_consensus.cc:2804] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:20.971552 1788 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:20.971796 2204 raft_consensus.cc:697] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:20.971798 1905 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.972823 2204 consensus_queue.cc:237] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:20.974030 1905 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:20.974087 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:20.974555 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:20.974656 1718 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.975057 1791 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:20.984882 1718 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:20.985821 1791 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:20.985891 1612 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:20.988517 1905 raft_consensus.cc:2804] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:52:20.988855 1905 raft_consensus.cc:697] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:20.988713 1541 catalog_manager.cc:5654] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:20.989538 1905 consensus_queue.cc:237] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:21.001614 1541 catalog_manager.cc:5654] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:21.012821 1842 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:21.013177 1842 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:21.014447 1842 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:21.015086 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:21.015255 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:21.015808 1718 raft_consensus.cc:2393] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 1: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:21.016501 1761 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:21.016999 1842 raft_consensus.cc:3060] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:21.021490 1842 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:21.042541 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:52:21.051296 2245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:52:21.054445 2246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:52:21.058319 426 server_base.cc:1047] running on GCE node
W20251215 20:52:21.058192 2248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:52:21.060429 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251215 20:52:21.060562 1646 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:52:21.060740 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:52:21.061022 426 hybrid_clock.cc:648] HybridClock initialized: now 1765831941061005 us; error 0 us; skew 500 ppm
I20251215 20:52:21.061772 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:52:21.070041 426 webserver.cc:492] Webserver started at http://127.0.106.132:33277/ using document root <none> and password file <none>
I20251215 20:52:21.070780 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:52:21.071116 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:52:21.071659 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:52:21.073449 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-3-root/instance:
uuid: "fbfdeb011a604f78a77f04be26573717"
format_stamp: "Formatted at 2025-12-15 20:52:21 on dist-test-slave-xp5d"
I20251215 20:52:21.078976 426 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20251215 20:52:21.085019 2254 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:21.085875 1905 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:21.086321 1905 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:21.087950 1905 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:21.088838 426 fs_manager.cc:730] Time spent opening block manager: real 0.008s user 0.001s sys 0.003s
I20251215 20:52:21.088904 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:21.089478 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-3-root
uuid: "fbfdeb011a604f78a77f04be26573717"
format_stamp: "Formatted at 2025-12-15 20:52:21 on dist-test-slave-xp5d"
I20251215 20:52:21.089876 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:52:21.088872 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:21.093269 1612 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:21.093983 1905 raft_consensus.cc:2749] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:52:21.108951 1646 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:21.113209 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:52:21.114748 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:52:21.116091 1842 consensus_queue.cc:1048] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.117738 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:52:21.119047 1646 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:21.128001 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:52:21.128355 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20251215 20:52:21.128682 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:52:21.128896 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:52:21.178654 2164 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.200265 2153 consensus_queue.cc:1048] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.206521 2153 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:21.223840 1640 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:52:21.235323 2140 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.260505 2140 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:21.261065 2140 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:21.266556 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:21.267279 1720 raft_consensus.cc:2468] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:21.268748 1612 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:21.270349 1905 raft_consensus.cc:2804] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:21.273531 2204 consensus_queue.cc:1048] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.270720 1905 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:21.274675 1905 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:21.294036 2107 consensus_queue.cc:1048] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:21.298593 2140 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:21.301914 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:21.330682 2107 consensus_queue.cc:1048] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:21.361924 2153 consensus_queue.cc:1048] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.365676 1905 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:21.368793 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:21.369450 1720 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:21.371168 1905 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:21.374231 1842 consensus_queue.cc:1048] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.378670 1640 raft_consensus.cc:1240] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20251215 20:52:21.380331 2164 consensus_queue.cc:1059] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.381290 2164 raft_consensus.cc:3055] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:21.381618 2164 raft_consensus.cc:740] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:21.382403 2164 consensus_queue.cc:260] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:21.385012 2140 consensus_queue.cc:1048] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:52:21.402441 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:21.420853 2164 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:21.469655 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 75549.8us
I20251215 20:52:21.503532 2103 consensus_queue.cc:1048] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.504341 1788 raft_consensus.cc:2410] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251215 20:52:21.509963 2103 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 20:52:21.528947 2206 consensus_queue.cc:1048] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.510882 1720 raft_consensus.cc:2468] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
W20251215 20:52:21.608364 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 58709us
I20251215 20:52:21.611033 1612 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:21.611846 1905 raft_consensus.cc:2804] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:21.612358 1905 raft_consensus.cc:697] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:21.613062 1905 consensus_queue.cc:237] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:21.628862 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 146025us
I20251215 20:52:21.642896 2025 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.678361 1543 catalog_manager.cc:5654] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:21.737141 2025 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:21.819443 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.132:44997
I20251215 20:52:21.819507 2345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.132:44997 every 8 connection(s)
I20251215 20:52:21.828259 426 auto_leader_rebalancer-test.cc:417] add a tserver: fbfdeb011a604f78a77f04be26573717
I20251215 20:52:21.843039 2346 heartbeater.cc:344] Connected to a master server at 127.0.106.190:34859
I20251215 20:52:21.843485 2346 heartbeater.cc:461] Registering TS with master...
I20251215 20:52:21.844195 2346 heartbeater.cc:507] Master 127.0.106.190:34859 requested a full tablet report, sending...
I20251215 20:52:21.845918 1544 ts_manager.cc:194] Registered new tserver with Master: fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:21.847198 1544 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47186
I20251215 20:52:22.028393 1720 raft_consensus.cc:1275] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 20:52:22.029390 2103 consensus_queue.cc:1048] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:22.040581 1789 raft_consensus.cc:1275] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20251215 20:52:22.040980 1789 pending_rounds.cc:85] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: Aborting all ops after (but not including) 0
I20251215 20:52:22.041282 1789 pending_rounds.cc:107] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20251215 20:52:22.041551 1789 raft_consensus.cc:2889] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:22.043165 1905 consensus_queue.cc:1048] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:52:22.251420 1789 consensus_queue.cc:237] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.256946 1721 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:22.258275 2291 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:22.261022 1646 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:22.262316 2291 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:22.266075 2297 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.267287 1721 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.283643 1544 catalog_manager.cc:5654] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251215 20:52:22.294834 1758 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8350524f9e4a49929464adde48de2442. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:22.313098 1721 consensus_queue.cc:237] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.314386 1646 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.318220 1789 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:22.320334 1862 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:22.326421 1644 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:22.328236 1862 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:22.338163 2206 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.342301 1789 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.343433 1646 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.354180 1721 consensus_queue.cc:237] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:22.357426 1684 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bb86f5c9ae14081b0e0633dacbfcb59. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:22.358073 1543 catalog_manager.cc:5654] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:22.367125 1788 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251215 20:52:22.369378 1684 consensus_peers.cc:597] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b3dcc96cf314cf3a1f3d46c0b6ee0e3. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:22.370357 2206 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:22.377586 1646 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:22.379200 2206 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:22.381592 1862 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.383145 1789 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.388502 1646 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.393594 1788 consensus_queue.cc:237] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.397567 1541 catalog_manager.cc:5654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251215 20:52:22.408142 1758 consensus_peers.cc:597] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2355bff2629046d8aedcfc2f63a52c18. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:22.410290 1721 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:22.411409 1646 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:22.412453 2369 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:22.415238 2298 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:22.427155 2291 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.428618 1720 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.445552 1541 catalog_manager.cc:5654] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:22.453420 1644 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:22.748778 2372 ts_tablet_manager.cc:933] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:22.750794 2372 tablet_copy_client.cc:323] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:45401
I20251215 20:52:22.760398 1805 tablet_copy_service.cc:140] P 95847161b0414d4e92d6cab94956fa57: Received BeginTabletCopySession request for tablet 8350524f9e4a49929464adde48de2442 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38896)
I20251215 20:52:22.760936 1805 tablet_copy_service.cc:161] P 95847161b0414d4e92d6cab94956fa57: Beginning new tablet copy session on tablet 8350524f9e4a49929464adde48de2442 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38896: session id = fbfdeb011a604f78a77f04be26573717-8350524f9e4a49929464adde48de2442
I20251215 20:52:22.768666 1805 tablet_copy_source_session.cc:215] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:22.771808 2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8350524f9e4a49929464adde48de2442. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:22.785079 2372 tablet_copy_client.cc:806] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:22.785667 2372 tablet_copy_client.cc:670] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:22.789582 2372 tablet_copy_client.cc:538] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:22.798497 2372 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:22.807834 2376 ts_tablet_manager.cc:933] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:22.810631 2376 tablet_copy_client.cc:323] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:37421
I20251215 20:52:22.823599 1731 tablet_copy_service.cc:140] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Received BeginTabletCopySession request for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38116)
I20251215 20:52:22.824151 1731 tablet_copy_service.cc:161] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Beginning new tablet copy session on tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38116: session id = fbfdeb011a604f78a77f04be26573717-9b3dcc96cf314cf3a1f3d46c0b6ee0e3
I20251215 20:52:22.824625 2372 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:22.825567 2372 tablet_bootstrap.cc:492] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:22.826196 2372 ts_tablet_manager.cc:1403] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.028s user 0.020s sys 0.002s
I20251215 20:52:22.828960 2372 raft_consensus.cc:359] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.829852 2372 raft_consensus.cc:740] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:22.830518 2372 consensus_queue.cc:260] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.835974 1731 tablet_copy_source_session.cc:215] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:22.838663 2376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:22.839956 2346 heartbeater.cc:499] Master 127.0.106.190:34859 was elected leader, sending a full tablet report...
I20251215 20:52:22.842528 2372 ts_tablet_manager.cc:1434] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.016s user 0.009s sys 0.006s
I20251215 20:52:22.844152 1805 tablet_copy_service.cc:342] P 95847161b0414d4e92d6cab94956fa57: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-8350524f9e4a49929464adde48de2442 received from {username='slave'} at 127.0.0.1:38896
I20251215 20:52:22.844596 1805 tablet_copy_service.cc:434] P 95847161b0414d4e92d6cab94956fa57: ending tablet copy session fbfdeb011a604f78a77f04be26573717-8350524f9e4a49929464adde48de2442 on tablet 8350524f9e4a49929464adde48de2442 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:22.852896 2376 tablet_copy_client.cc:806] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:22.853528 2376 tablet_copy_client.cc:670] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:22.857718 2376 tablet_copy_client.cc:538] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:22.865757 2376 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:22.877442 2372 ts_tablet_manager.cc:933] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:22.878947 2372 tablet_copy_client.cc:323] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:37421
I20251215 20:52:22.880478 1731 tablet_copy_service.cc:140] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Received BeginTabletCopySession request for tablet 0bb86f5c9ae14081b0e0633dacbfcb59 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38116)
I20251215 20:52:22.880975 1731 tablet_copy_service.cc:161] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Beginning new tablet copy session on tablet 0bb86f5c9ae14081b0e0633dacbfcb59 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38116: session id = fbfdeb011a604f78a77f04be26573717-0bb86f5c9ae14081b0e0633dacbfcb59
I20251215 20:52:22.884936 2376 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:22.885846 2376 tablet_bootstrap.cc:492] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:22.886504 2376 ts_tablet_manager.cc:1403] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.012s
I20251215 20:52:22.888304 1731 tablet_copy_source_session.cc:215] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:22.888753 2376 raft_consensus.cc:359] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.889601 2376 raft_consensus.cc:740] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:22.890208 2376 consensus_queue.cc:260] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.891418 2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb86f5c9ae14081b0e0633dacbfcb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:22.898231 2376 ts_tablet_manager.cc:1434] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20251215 20:52:22.905138 1731 tablet_copy_service.cc:342] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-9b3dcc96cf314cf3a1f3d46c0b6ee0e3 received from {username='slave'} at 127.0.0.1:38116
I20251215 20:52:22.905550 1731 tablet_copy_service.cc:434] P be5dd78ebc024aefa4d17b3ccf2ea1ac: ending tablet copy session fbfdeb011a604f78a77f04be26573717-9b3dcc96cf314cf3a1f3d46c0b6ee0e3 on tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:22.906683 2372 tablet_copy_client.cc:806] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:22.907284 2372 tablet_copy_client.cc:670] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:22.911526 2372 tablet_copy_client.cc:538] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:22.918918 2372 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:22.935263 2372 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:22.936053 2372 tablet_bootstrap.cc:492] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:22.936643 2372 ts_tablet_manager.cc:1403] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.018s user 0.019s sys 0.000s
I20251215 20:52:22.938791 2372 raft_consensus.cc:359] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.939410 2372 raft_consensus.cc:740] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:22.939898 2372 consensus_queue.cc:260] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:22.942037 2372 ts_tablet_manager.cc:1434] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:52:22.943681 1731 tablet_copy_service.cc:342] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-0bb86f5c9ae14081b0e0633dacbfcb59 received from {username='slave'} at 127.0.0.1:38116
I20251215 20:52:22.944073 1731 tablet_copy_service.cc:434] P be5dd78ebc024aefa4d17b3ccf2ea1ac: ending tablet copy session fbfdeb011a604f78a77f04be26573717-0bb86f5c9ae14081b0e0633dacbfcb59 on tablet 0bb86f5c9ae14081b0e0633dacbfcb59 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:22.998147 2372 ts_tablet_manager.cc:933] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:23.001035 2372 tablet_copy_client.cc:323] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:45401
I20251215 20:52:23.002698 1805 tablet_copy_service.cc:140] P 95847161b0414d4e92d6cab94956fa57: Received BeginTabletCopySession request for tablet 2355bff2629046d8aedcfc2f63a52c18 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38896)
I20251215 20:52:23.003125 1805 tablet_copy_service.cc:161] P 95847161b0414d4e92d6cab94956fa57: Beginning new tablet copy session on tablet 2355bff2629046d8aedcfc2f63a52c18 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38896: session id = fbfdeb011a604f78a77f04be26573717-2355bff2629046d8aedcfc2f63a52c18
I20251215 20:52:23.008009 1805 tablet_copy_source_session.cc:215] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:23.012346 2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2355bff2629046d8aedcfc2f63a52c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:23.026525 2372 tablet_copy_client.cc:806] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:23.027062 2372 tablet_copy_client.cc:670] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:23.029928 2372 tablet_copy_client.cc:538] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:23.036218 2372 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:23.050828 2372 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:23.051524 2372 tablet_bootstrap.cc:492] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:23.051991 2372 ts_tablet_manager.cc:1403] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.016s user 0.016s sys 0.000s
I20251215 20:52:23.053910 2372 raft_consensus.cc:359] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:23.054756 2372 raft_consensus.cc:740] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:23.055317 2372 consensus_queue.cc:260] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:23.057130 2372 ts_tablet_manager.cc:1434] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20251215 20:52:23.059060 1805 tablet_copy_service.cc:342] P 95847161b0414d4e92d6cab94956fa57: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-2355bff2629046d8aedcfc2f63a52c18 received from {username='slave'} at 127.0.0.1:38896
I20251215 20:52:23.059399 1805 tablet_copy_service.cc:434] P 95847161b0414d4e92d6cab94956fa57: ending tablet copy session fbfdeb011a604f78a77f04be26573717-2355bff2629046d8aedcfc2f63a52c18 on tablet 2355bff2629046d8aedcfc2f63a52c18 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:23.120179 2320 raft_consensus.cc:1217] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:23.326622 2320 raft_consensus.cc:1217] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:23.340992 2320 raft_consensus.cc:1217] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:23.597429 2320 raft_consensus.cc:1217] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:23.661092 2369 raft_consensus.cc:1064] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:23.663420 2369 consensus_queue.cc:237] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:23.669981 1721 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.671342 1639 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.670559 2320 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.672123 2291 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:23.673884 2298 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:23.676939 2291 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:23.685231 2291 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.691926 1639 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.690359 2320 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.705773 1541 catalog_manager.cc:5654] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:23.707562 1721 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.740749 1789 consensus_queue.cc:237] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:23.744907 2320 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:23.745714 1639 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:23.746296 2298 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:23.747757 2369 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:23.752918 2291 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.754448 2320 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.755215 1644 raft_consensus.cc:2955] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.779203 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 8350524f9e4a49929464adde48de2442 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:23.782274 1543 catalog_manager.cc:5654] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.793299 1703 tablet_service.cc:1552] Processing DeleteTablet for tablet 8350524f9e4a49929464adde48de2442 with delete_type TABLET_DATA_TOMBSTONED (TS be5dd78ebc024aefa4d17b3ccf2ea1ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34122
I20251215 20:52:23.807909 2396 tablet_replica.cc:333] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:52:23.808925 2396 raft_consensus.cc:2243] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:23.817413 2396 raft_consensus.cc:2272] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:23.821244 2396 ts_tablet_manager.cc:1916] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:23.834290 2396 ts_tablet_manager.cc:1929] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:23.834770 2396 log.cc:1199] T 8350524f9e4a49929464adde48de2442 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root/wals/8350524f9e4a49929464adde48de2442
I20251215 20:52:23.838204 1531 catalog_manager.cc:4985] TS be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): tablet 8350524f9e4a49929464adde48de2442 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:23.902536 1862 raft_consensus.cc:1064] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:23.904556 1862 consensus_queue.cc:237] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:23.910663 2320 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.911695 2365 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:23.912150 1789 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.913873 2365 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251215 20:52:23.917906 1639 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.920249 2398 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:23.924685 2365 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.931361 1789 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.939828 2320 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.938506 1862 raft_consensus.cc:1064] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:23.953297 1542 catalog_manager.cc:5654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.954667 1862 consensus_queue.cc:237] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:23.962098 2320 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.961498 1644 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:23.963792 2398 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:23.965145 1639 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.966753 2398 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:23.976480 1717 consensus_queue.cc:237] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:23.980937 1789 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:23.985623 2398 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:23.988379 1788 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:23.993757 2405 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:23.994342 2320 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:24.001801 2405 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20251215 20:52:24.002972 2398 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.003782 1792 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.004658 2365 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.009495 1789 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.014995 2320 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.018810 1542 catalog_manager.cc:5654] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.021572 1644 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.024940 2319 raft_consensus.cc:2955] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.075277 2395 raft_consensus.cc:1064] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:24.076665 1543 catalog_manager.cc:5654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.078320 2395 consensus_queue.cc:237] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:24.089923 1636 tablet_service.cc:1552] Processing DeleteTablet for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 with delete_type TABLET_DATA_TOMBSTONED (TS 9b3367a5854f49b98da54556a209b0de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43794
I20251215 20:52:24.097118 2318 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:24.098527 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:24.098733 2395 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:24.099846 1721 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:24.106635 1646 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:24.108330 2298 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:24.110599 2369 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251215 20:52:24.126346 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 51011.9us
I20251215 20:52:24.127521 2412 tablet_replica.cc:333] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:24.128633 2412 raft_consensus.cc:2243] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:24.129390 2412 raft_consensus.cc:2272] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:24.135365 2412 ts_tablet_manager.cc:1916] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:24.141136 1721 consensus_queue.cc:237] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:24.146864 2318 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:24.148232 1862 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:24.155669 2298 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.166297 2365 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.166630 2320 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.168537 2412 ts_tablet_manager.cc:1929] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:24.171681 2412 log.cc:1199] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 9b3367a5854f49b98da54556a209b0de: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root/wals/9b3dcc96cf314cf3a1f3d46c0b6ee0e3
I20251215 20:52:24.175629 2318 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.176015 1718 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.179221 1544 catalog_manager.cc:5654] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.182611 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 0bb86f5c9ae14081b0e0633dacbfcb59 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:24.182390 1644 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.188998 1530 catalog_manager.cc:4985] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): tablet 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:24.194521 1544 catalog_manager.cc:5654] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:24.175351 1646 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:24.204126 2365 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:24.206830 1782 tablet_service.cc:1552] Processing DeleteTablet for tablet 0bb86f5c9ae14081b0e0633dacbfcb59 with delete_type TABLET_DATA_TOMBSTONED (TS 95847161b0414d4e92d6cab94956fa57 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46036
I20251215 20:52:24.209160 1646 raft_consensus.cc:2955] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.226900 2417 tablet_replica.cc:333] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:52:24.228022 2417 raft_consensus.cc:2243] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:24.228829 2417 raft_consensus.cc:2272] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:24.242511 1792 consensus_queue.cc:237] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:24.247143 2318 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:24.247611 1717 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:24.248752 2369 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:24.249032 2417 ts_tablet_manager.cc:1916] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:24.249502 2298 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:24.256837 2369 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.258548 2320 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.264393 1717 raft_consensus.cc:2955] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.266685 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 2355bff2629046d8aedcfc2f63a52c18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:24.277277 1542 catalog_manager.cc:5654] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:24.281590 2417 ts_tablet_manager.cc:1929] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:24.281987 2417 log.cc:1199] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 95847161b0414d4e92d6cab94956fa57: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root/wals/0bb86f5c9ae14081b0e0633dacbfcb59
I20251215 20:52:24.283558 1531 catalog_manager.cc:4985] TS 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): tablet 0bb86f5c9ae14081b0e0633dacbfcb59 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:24.288872 1636 tablet_service.cc:1552] Processing DeleteTablet for tablet 2355bff2629046d8aedcfc2f63a52c18 with delete_type TABLET_DATA_TOMBSTONED (TS 9b3367a5854f49b98da54556a209b0de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43794
I20251215 20:52:24.289625 2412 tablet_replica.cc:333] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:24.290294 2412 raft_consensus.cc:2243] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:24.290822 2412 raft_consensus.cc:2272] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:24.293445 2412 ts_tablet_manager.cc:1916] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:24.302795 2412 ts_tablet_manager.cc:1929] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:24.303133 2412 log.cc:1199] T 2355bff2629046d8aedcfc2f63a52c18 P 9b3367a5854f49b98da54556a209b0de: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root/wals/2355bff2629046d8aedcfc2f63a52c18
I20251215 20:52:24.304497 1530 catalog_manager.cc:4985] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): tablet 2355bff2629046d8aedcfc2f63a52c18 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:25.326934 1718 consensus_queue.cc:237] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:25.331816 1792 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:25.332132 1644 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251215 20:52:25.332275 1684 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f91c85f57504082af247cc60403edd1. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:25.333253 2365 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:25.333890 2403 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:25.342209 2403 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.343675 1792 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.357762 1542 catalog_manager.cc:5654] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:25.361233 1646 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.383365 1646 consensus_queue.cc:237] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:25.389904 1718 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:25.390661 1792 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:25.392438 1905 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:25.398674 2410 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251215 20:52:25.408347 1609 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f8f38b230664bc1a6c03587a328cca0. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:25.418159 2428 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.419476 1718 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.419675 1792 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.434793 1788 consensus_queue.cc:237] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:25.438548 1543 catalog_manager.cc:5654] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.451685 1718 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:25.452756 1646 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:25.452986 2298 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251215 20:52:25.453930 1758 consensus_peers.cc:597] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7403a55fe6fa41268e8b54130c9e785d. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:25.454397 2416 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:25.460913 2416 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.461757 1718 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.474193 1646 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.481405 1543 catalog_manager.cc:5654] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:25.487425 1788 consensus_queue.cc:237] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:25.501582 1717 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:25.501751 1646 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251215 20:52:25.501829 1758 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed49fbba2c19424aa9617a846079bcb3. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:25.503109 2436 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:25.505488 2298 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:25.513365 2437 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.514674 1646 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.517969 1717 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:25.530632 1544 catalog_manager.cc:5654] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:25.805851 2441 ts_tablet_manager.cc:933] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:25.807536 2441 tablet_copy_client.cc:323] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:38541
I20251215 20:52:25.817507 1656 tablet_copy_service.cc:140] P 9b3367a5854f49b98da54556a209b0de: Received BeginTabletCopySession request for tablet 3f8f38b230664bc1a6c03587a328cca0 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:59670)
I20251215 20:52:25.818041 1656 tablet_copy_service.cc:161] P 9b3367a5854f49b98da54556a209b0de: Beginning new tablet copy session on tablet 3f8f38b230664bc1a6c03587a328cca0 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:59670: session id = fbfdeb011a604f78a77f04be26573717-3f8f38b230664bc1a6c03587a328cca0
I20251215 20:52:25.823968 1656 tablet_copy_source_session.cc:215] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:25.826720 2441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8f38b230664bc1a6c03587a328cca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:25.840126 2441 tablet_copy_client.cc:806] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:25.840868 2441 tablet_copy_client.cc:670] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:25.845546 2441 tablet_copy_client.cc:538] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:25.853096 2441 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:25.870038 2441 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:25.870694 2441 tablet_bootstrap.cc:492] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:25.871188 2441 ts_tablet_manager.cc:1403] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.000s
I20251215 20:52:25.873605 2441 raft_consensus.cc:359] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:25.874285 2441 raft_consensus.cc:740] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:25.874761 2441 consensus_queue.cc:260] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:25.877611 2441 ts_tablet_manager.cc:1434] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251215 20:52:25.879225 1656 tablet_copy_service.cc:342] P 9b3367a5854f49b98da54556a209b0de: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-3f8f38b230664bc1a6c03587a328cca0 received from {username='slave'} at 127.0.0.1:59670
I20251215 20:52:25.879644 1656 tablet_copy_service.cc:434] P 9b3367a5854f49b98da54556a209b0de: ending tablet copy session fbfdeb011a604f78a77f04be26573717-3f8f38b230664bc1a6c03587a328cca0 on tablet 3f8f38b230664bc1a6c03587a328cca0 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:25.885385 2441 ts_tablet_manager.cc:933] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:25.886933 2441 tablet_copy_client.cc:323] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:37421
I20251215 20:52:25.888516 1731 tablet_copy_service.cc:140] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Received BeginTabletCopySession request for tablet 5f91c85f57504082af247cc60403edd1 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38116)
I20251215 20:52:25.888965 1731 tablet_copy_service.cc:161] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Beginning new tablet copy session on tablet 5f91c85f57504082af247cc60403edd1 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38116: session id = fbfdeb011a604f78a77f04be26573717-5f91c85f57504082af247cc60403edd1
I20251215 20:52:25.894879 1731 tablet_copy_source_session.cc:215] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:25.898305 2441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f91c85f57504082af247cc60403edd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:25.903877 2446 ts_tablet_manager.cc:933] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:25.905640 2446 tablet_copy_client.cc:323] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:45401
I20251215 20:52:25.906965 1805 tablet_copy_service.cc:140] P 95847161b0414d4e92d6cab94956fa57: Received BeginTabletCopySession request for tablet 7403a55fe6fa41268e8b54130c9e785d from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38896)
I20251215 20:52:25.907398 1805 tablet_copy_service.cc:161] P 95847161b0414d4e92d6cab94956fa57: Beginning new tablet copy session on tablet 7403a55fe6fa41268e8b54130c9e785d from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38896: session id = fbfdeb011a604f78a77f04be26573717-7403a55fe6fa41268e8b54130c9e785d
I20251215 20:52:25.916563 2441 tablet_copy_client.cc:806] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:25.916901 1805 tablet_copy_source_session.cc:215] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:25.917196 2441 tablet_copy_client.cc:670] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:25.920001 2446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7403a55fe6fa41268e8b54130c9e785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:25.920388 2441 tablet_copy_client.cc:538] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:25.928517 2441 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:25.946631 2450 ts_tablet_manager.cc:933] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:25.974702 2446 tablet_copy_client.cc:806] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:25.978734 2446 tablet_copy_client.cc:670] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:25.982709 2446 tablet_copy_client.cc:538] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:25.993089 2450 tablet_copy_client.cc:323] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:45401
I20251215 20:52:25.994488 1805 tablet_copy_service.cc:140] P 95847161b0414d4e92d6cab94956fa57: Received BeginTabletCopySession request for tablet ed49fbba2c19424aa9617a846079bcb3 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38896)
I20251215 20:52:25.995007 1805 tablet_copy_service.cc:161] P 95847161b0414d4e92d6cab94956fa57: Beginning new tablet copy session on tablet ed49fbba2c19424aa9617a846079bcb3 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38896: session id = fbfdeb011a604f78a77f04be26573717-ed49fbba2c19424aa9617a846079bcb3
I20251215 20:52:25.996280 2446 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:26.002591 2441 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:26.003509 2441 tablet_bootstrap.cc:492] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:26.004148 2441 ts_tablet_manager.cc:1403] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.076s user 0.017s sys 0.029s
I20251215 20:52:26.004979 1805 tablet_copy_source_session.cc:215] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:26.006745 2441 raft_consensus.cc:359] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:26.007393 2441 raft_consensus.cc:740] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:26.008014 2450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed49fbba2c19424aa9617a846079bcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:26.007869 2441 consensus_queue.cc:260] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:26.015417 2441 ts_tablet_manager.cc:1434] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20251215 20:52:26.019491 1731 tablet_copy_service.cc:342] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-5f91c85f57504082af247cc60403edd1 received from {username='slave'} at 127.0.0.1:38116
I20251215 20:52:26.019909 1731 tablet_copy_service.cc:434] P be5dd78ebc024aefa4d17b3ccf2ea1ac: ending tablet copy session fbfdeb011a604f78a77f04be26573717-5f91c85f57504082af247cc60403edd1 on tablet 5f91c85f57504082af247cc60403edd1 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:26.029106 2446 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:26.030002 2446 tablet_bootstrap.cc:492] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:26.030704 2446 ts_tablet_manager.cc:1403] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.035s user 0.025s sys 0.000s
I20251215 20:52:26.033470 2446 raft_consensus.cc:359] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:26.034325 2446 raft_consensus.cc:740] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:26.034987 2446 consensus_queue.cc:260] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:26.035596 2450 tablet_copy_client.cc:806] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:26.037544 2446 ts_tablet_manager.cc:1434] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:52:26.038211 2450 tablet_copy_client.cc:670] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:26.038940 1805 tablet_copy_service.cc:342] P 95847161b0414d4e92d6cab94956fa57: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-7403a55fe6fa41268e8b54130c9e785d received from {username='slave'} at 127.0.0.1:38896
I20251215 20:52:26.039386 1805 tablet_copy_service.cc:434] P 95847161b0414d4e92d6cab94956fa57: ending tablet copy session fbfdeb011a604f78a77f04be26573717-7403a55fe6fa41268e8b54130c9e785d on tablet 7403a55fe6fa41268e8b54130c9e785d with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:26.043118 2450 tablet_copy_client.cc:538] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:26.053512 2450 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:26.071250 2450 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:26.073086 2450 tablet_bootstrap.cc:492] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:26.073691 2450 ts_tablet_manager.cc:1403] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.004s
I20251215 20:52:26.076759 2450 raft_consensus.cc:359] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:26.077581 2450 raft_consensus.cc:740] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:26.078382 2450 consensus_queue.cc:260] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:26.080739 2450 ts_tablet_manager.cc:1434] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251215 20:52:26.082013 1805 tablet_copy_service.cc:342] P 95847161b0414d4e92d6cab94956fa57: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-ed49fbba2c19424aa9617a846079bcb3 received from {username='slave'} at 127.0.0.1:38896
I20251215 20:52:26.082441 1805 tablet_copy_service.cc:434] P 95847161b0414d4e92d6cab94956fa57: ending tablet copy session fbfdeb011a604f78a77f04be26573717-ed49fbba2c19424aa9617a846079bcb3 on tablet ed49fbba2c19424aa9617a846079bcb3 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:26.275018 2320 raft_consensus.cc:1217] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:26.428213 2320 raft_consensus.cc:1217] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:26.459702 2320 raft_consensus.cc:1217] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:26.492798 2320 raft_consensus.cc:1217] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:26.689482 2455 raft_consensus.cc:1064] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:26.692066 2455 consensus_queue.cc:237] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:26.698863 2320 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.699502 1792 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.700225 1721 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.700824 2410 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.701638 2455 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.702303 1905 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.736270 2455 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.738744 1721 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.742403 1792 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.753312 2320 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.774688 1542 catalog_manager.cc:5654] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.807301 1646 consensus_queue.cc:237] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:26.813915 2320 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:26.815138 1791 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:26.815196 2410 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251215 20:52:26.816890 1905 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:26.821700 2410 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.823143 2320 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.829051 1791 raft_consensus.cc:2955] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.834239 1530 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3f8f38b230664bc1a6c03587a328cca0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:26.846585 1544 catalog_manager.cc:5654] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de reported cstate change: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:26.855641 1703 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f8f38b230664bc1a6c03587a328cca0 with delete_type TABLET_DATA_TOMBSTONED (TS be5dd78ebc024aefa4d17b3ccf2ea1ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34122
I20251215 20:52:26.859939 2465 tablet_replica.cc:333] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:52:26.860862 2465 raft_consensus.cc:2243] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:26.861536 2465 raft_consensus.cc:2272] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:26.864171 2465 ts_tablet_manager.cc:1916] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:26.876806 2465 ts_tablet_manager.cc:1929] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:26.877184 2465 log.cc:1199] T 3f8f38b230664bc1a6c03587a328cca0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root/wals/3f8f38b230664bc1a6c03587a328cca0
I20251215 20:52:26.878520 1531 catalog_manager.cc:4985] TS be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): tablet 3f8f38b230664bc1a6c03587a328cca0 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:26.882097 2402 raft_consensus.cc:1064] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:26.883773 2402 consensus_queue.cc:237] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:26.892679 2320 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.894358 1792 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.894933 1646 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.895663 2403 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.896492 2454 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.897403 2402 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.912057 2402 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.918172 1791 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.925004 2318 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.927685 1544 catalog_manager.cc:5654] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:26.937263 1644 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:26.939023 2416 raft_consensus.cc:1064] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:26.943130 2416 consensus_queue.cc:237] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:26.957336 1717 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.958418 1641 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.958556 2436 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.960240 2416 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.961795 2318 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:26.965921 2416 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:26.970554 1718 consensus_queue.cc:237] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:26.975677 2320 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:26.979178 1641 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:26.981499 2402 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251215 20:52:26.982834 2437 raft_consensus.cc:1064] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:26.982707 2470 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:26.985288 2437 consensus_queue.cc:237] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:27.005487 2403 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.008637 2318 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.013459 1641 raft_consensus.cc:2955] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.016343 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 5f91c85f57504082af247cc60403edd1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:27.022586 1544 catalog_manager.cc:5654] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:27.025694 2478 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
W20251215 20:52:27.030727 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 46586.9us
I20251215 20:52:27.033140 1646 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:27.032935 1717 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
W20251215 20:52:27.036754 1758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 52969.7us
I20251215 20:52:27.038795 2320 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:27.042870 1782 tablet_service.cc:1552] Processing DeleteTablet for tablet 5f91c85f57504082af247cc60403edd1 with delete_type TABLET_DATA_TOMBSTONED (TS 95847161b0414d4e92d6cab94956fa57 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46036
I20251215 20:52:27.043994 2437 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20251215 20:52:27.065054 1544 catalog_manager.cc:5654] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.066202 1717 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:27.068006 2320 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.080124 2477 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20251215 20:52:27.081111 2436 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:27.091912 1641 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.120971 2482 tablet_replica.cc:333] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:52:27.122051 2482 raft_consensus.cc:2243] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:27.122776 2482 raft_consensus.cc:2272] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:27.127377 2436 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.130275 2482 ts_tablet_manager.cc:1916] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:27.134624 1792 consensus_queue.cc:237] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:27.145833 1718 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.147095 1644 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:27.148811 2478 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:27.150770 2482 ts_tablet_manager.cc:1929] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:27.151237 2482 log.cc:1199] T 5f91c85f57504082af247cc60403edd1 P 95847161b0414d4e92d6cab94956fa57: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root/wals/5f91c85f57504082af247cc60403edd1
I20251215 20:52:27.153015 1531 catalog_manager.cc:4985] TS 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): tablet 5f91c85f57504082af247cc60403edd1 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:27.155786 2477 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.157049 2318 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:27.159233 2318 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.161921 1644 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.168206 2478 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:27.169782 1641 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.172629 1543 catalog_manager.cc:5654] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.180414 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet ed49fbba2c19424aa9617a846079bcb3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:27.182451 2318 raft_consensus.cc:2955] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.199746 1543 catalog_manager.cc:5654] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.213212 1703 tablet_service.cc:1552] Processing DeleteTablet for tablet ed49fbba2c19424aa9617a846079bcb3 with delete_type TABLET_DATA_TOMBSTONED (TS be5dd78ebc024aefa4d17b3ccf2ea1ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34122
I20251215 20:52:27.214176 2465 tablet_replica.cc:333] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:52:27.215152 2465 raft_consensus.cc:2243] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:27.215792 2465 raft_consensus.cc:2272] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:27.218641 2465 ts_tablet_manager.cc:1916] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:27.221117 1792 consensus_queue.cc:237] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:27.231370 1721 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:27.231617 2318 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:27.233948 2465 ts_tablet_manager.cc:1929] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:27.234580 2465 log.cc:1199] T ed49fbba2c19424aa9617a846079bcb3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root/wals/ed49fbba2c19424aa9617a846079bcb3
I20251215 20:52:27.232972 2437 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20251215 20:52:27.236155 1531 catalog_manager.cc:4985] TS be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): tablet ed49fbba2c19424aa9617a846079bcb3 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:27.236374 2437 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:27.240180 2437 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.241643 1718 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.245893 2318 raft_consensus.cc:2955] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.249708 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 7403a55fe6fa41268e8b54130c9e785d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:27.257962 1541 catalog_manager.cc:5654] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:27.269874 1636 tablet_service.cc:1552] Processing DeleteTablet for tablet 7403a55fe6fa41268e8b54130c9e785d with delete_type TABLET_DATA_TOMBSTONED (TS 9b3367a5854f49b98da54556a209b0de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43794
I20251215 20:52:27.271531 2486 tablet_replica.cc:333] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:27.272533 2486 raft_consensus.cc:2243] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:27.273226 2486 raft_consensus.cc:2272] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:27.275907 2486 ts_tablet_manager.cc:1916] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:27.288601 2486 ts_tablet_manager.cc:1929] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:27.288882 2486 log.cc:1199] T 7403a55fe6fa41268e8b54130c9e785d P 9b3367a5854f49b98da54556a209b0de: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root/wals/7403a55fe6fa41268e8b54130c9e785d
I20251215 20:52:27.289992 1530 catalog_manager.cc:4985] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): tablet 7403a55fe6fa41268e8b54130c9e785d (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:28.313690 1644 consensus_queue.cc:237] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:28.319149 1788 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251215 20:52:28.319568 1609 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cffb60a2970e4e049f29999509c860aa. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:28.320611 1721 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:28.321049 2488 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:28.322314 2457 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:28.327877 2488 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.329520 1788 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.332959 1721 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.343077 1718 consensus_queue.cc:237] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:28.347093 1541 catalog_manager.cc:5654] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:28.357702 1788 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251215 20:52:28.361122 1684 consensus_peers.cc:597] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86d34bd4c9884678a883bfc6fe5393a8. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:28.362466 2491 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:28.370930 1644 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:28.379050 2454 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:28.387774 2403 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.389307 1788 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.406098 1644 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.415356 1543 catalog_manager.cc:5654] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.430672 1644 consensus_queue.cc:237] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:28.458048 1609 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbf9f34352854272976701e2b99044e6. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:28.459481 1792 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:28.459689 1721 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:28.461241 2410 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:28.462733 2410 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:28.467963 2410 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.469532 1721 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.471086 1788 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.479012 1644 consensus_queue.cc:237] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:28.482941 1541 catalog_manager.cc:5654] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251215 20:52:28.488631 1609 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10e7dc78d083418c9f49bb4450d426f7. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:28.491150 1792 raft_consensus.cc:1275] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:28.491247 1721 raft_consensus.cc:1275] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:28.493490 2457 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:28.494242 2410 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:28.502701 2410 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.504222 1718 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.508992 1788 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.527145 1541 catalog_manager.cc:5654] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:28.777834 2508 ts_tablet_manager.cc:933] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:28.779815 2508 tablet_copy_client.cc:323] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:37421
I20251215 20:52:28.781138 1731 tablet_copy_service.cc:140] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Received BeginTabletCopySession request for tablet 86d34bd4c9884678a883bfc6fe5393a8 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38116)
I20251215 20:52:28.781581 1731 tablet_copy_service.cc:161] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Beginning new tablet copy session on tablet 86d34bd4c9884678a883bfc6fe5393a8 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38116: session id = fbfdeb011a604f78a77f04be26573717-86d34bd4c9884678a883bfc6fe5393a8
I20251215 20:52:28.788411 1731 tablet_copy_source_session.cc:215] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:28.792438 2508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d34bd4c9884678a883bfc6fe5393a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:28.804929 2508 tablet_copy_client.cc:806] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:28.805521 2508 tablet_copy_client.cc:670] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:28.808799 2508 tablet_copy_client.cc:538] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:28.816861 2508 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:28.825388 2510 ts_tablet_manager.cc:933] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:28.830104 2510 tablet_copy_client.cc:323] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:38541
I20251215 20:52:28.831571 1656 tablet_copy_service.cc:140] P 9b3367a5854f49b98da54556a209b0de: Received BeginTabletCopySession request for tablet cffb60a2970e4e049f29999509c860aa from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:59670)
I20251215 20:52:28.832010 1656 tablet_copy_service.cc:161] P 9b3367a5854f49b98da54556a209b0de: Beginning new tablet copy session on tablet cffb60a2970e4e049f29999509c860aa from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:59670: session id = fbfdeb011a604f78a77f04be26573717-cffb60a2970e4e049f29999509c860aa
I20251215 20:52:28.836820 2508 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:28.837675 2508 tablet_bootstrap.cc:492] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:28.838295 2508 ts_tablet_manager.cc:1403] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.007s
I20251215 20:52:28.838359 1656 tablet_copy_source_session.cc:215] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:28.841404 2510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffb60a2970e4e049f29999509c860aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:28.841076 2508 raft_consensus.cc:359] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:28.841926 2508 raft_consensus.cc:740] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:28.842609 2508 consensus_queue.cc:260] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:28.855535 2508 ts_tablet_manager.cc:1434] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.017s user 0.009s sys 0.005s
I20251215 20:52:28.858045 2510 tablet_copy_client.cc:806] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:28.858546 1731 tablet_copy_service.cc:342] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-86d34bd4c9884678a883bfc6fe5393a8 received from {username='slave'} at 127.0.0.1:38116
I20251215 20:52:28.858645 2510 tablet_copy_client.cc:670] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:28.859028 1731 tablet_copy_service.cc:434] P be5dd78ebc024aefa4d17b3ccf2ea1ac: ending tablet copy session fbfdeb011a604f78a77f04be26573717-86d34bd4c9884678a883bfc6fe5393a8 on tablet 86d34bd4c9884678a883bfc6fe5393a8 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:28.867305 2510 tablet_copy_client.cc:538] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:28.875077 2510 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:28.897598 2510 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:28.898546 2510 tablet_bootstrap.cc:492] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:28.899233 2510 ts_tablet_manager.cc:1403] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.024s user 0.022s sys 0.000s
I20251215 20:52:28.902057 2510 raft_consensus.cc:359] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:28.902910 2510 raft_consensus.cc:740] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:28.903571 2510 consensus_queue.cc:260] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:28.906388 2510 ts_tablet_manager.cc:1434] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:52:28.907761 1656 tablet_copy_service.cc:342] P 9b3367a5854f49b98da54556a209b0de: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-cffb60a2970e4e049f29999509c860aa received from {username='slave'} at 127.0.0.1:59670
I20251215 20:52:28.908160 1656 tablet_copy_service.cc:434] P 9b3367a5854f49b98da54556a209b0de: ending tablet copy session fbfdeb011a604f78a77f04be26573717-cffb60a2970e4e049f29999509c860aa on tablet cffb60a2970e4e049f29999509c860aa with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:28.983898 2510 ts_tablet_manager.cc:933] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:28.989027 2510 tablet_copy_client.cc:323] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:38541
I20251215 20:52:28.990392 1656 tablet_copy_service.cc:140] P 9b3367a5854f49b98da54556a209b0de: Received BeginTabletCopySession request for tablet cbf9f34352854272976701e2b99044e6 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:59670)
I20251215 20:52:28.990942 1656 tablet_copy_service.cc:161] P 9b3367a5854f49b98da54556a209b0de: Beginning new tablet copy session on tablet cbf9f34352854272976701e2b99044e6 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:59670: session id = fbfdeb011a604f78a77f04be26573717-cbf9f34352854272976701e2b99044e6
I20251215 20:52:28.997488 1656 tablet_copy_source_session.cc:215] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:29.001084 2510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf9f34352854272976701e2b99044e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:29.015614 2508 ts_tablet_manager.cc:933] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:29.019125 2508 tablet_copy_client.cc:323] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:38541
I20251215 20:52:29.020401 1656 tablet_copy_service.cc:140] P 9b3367a5854f49b98da54556a209b0de: Received BeginTabletCopySession request for tablet 10e7dc78d083418c9f49bb4450d426f7 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:59670)
I20251215 20:52:29.020983 2510 tablet_copy_client.cc:806] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:29.021230 1656 tablet_copy_service.cc:161] P 9b3367a5854f49b98da54556a209b0de: Beginning new tablet copy session on tablet 10e7dc78d083418c9f49bb4450d426f7 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:59670: session id = fbfdeb011a604f78a77f04be26573717-10e7dc78d083418c9f49bb4450d426f7
I20251215 20:52:29.021529 2510 tablet_copy_client.cc:670] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:29.024597 2510 tablet_copy_client.cc:538] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:29.027743 1656 tablet_copy_source_session.cc:215] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:29.032003 2508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e7dc78d083418c9f49bb4450d426f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:29.034559 2510 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:29.055830 2510 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:29.056671 2510 tablet_bootstrap.cc:492] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:29.057163 2510 ts_tablet_manager.cc:1403] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.003s
I20251215 20:52:29.059321 2508 tablet_copy_client.cc:806] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:29.059630 2510 raft_consensus.cc:359] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:29.060555 2510 raft_consensus.cc:740] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:29.061331 2510 consensus_queue.cc:260] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:29.063552 2510 ts_tablet_manager.cc:1434] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:52:29.060563 2508 tablet_copy_client.cc:670] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:29.065114 1656 tablet_copy_service.cc:342] P 9b3367a5854f49b98da54556a209b0de: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-cbf9f34352854272976701e2b99044e6 received from {username='slave'} at 127.0.0.1:59670
I20251215 20:52:29.065507 1656 tablet_copy_service.cc:434] P 9b3367a5854f49b98da54556a209b0de: ending tablet copy session fbfdeb011a604f78a77f04be26573717-cbf9f34352854272976701e2b99044e6 on tablet cbf9f34352854272976701e2b99044e6 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:29.068236 2508 tablet_copy_client.cc:538] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:29.079178 2508 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:29.095803 2508 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:29.096490 2508 tablet_bootstrap.cc:492] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:29.097051 2508 ts_tablet_manager.cc:1403] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.008s
I20251215 20:52:29.099138 2508 raft_consensus.cc:359] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:29.099684 2508 raft_consensus.cc:740] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:29.100135 2508 consensus_queue.cc:260] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:29.102185 2508 ts_tablet_manager.cc:1434] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:52:29.103600 1656 tablet_copy_service.cc:342] P 9b3367a5854f49b98da54556a209b0de: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-10e7dc78d083418c9f49bb4450d426f7 received from {username='slave'} at 127.0.0.1:59670
I20251215 20:52:29.103988 1656 tablet_copy_service.cc:434] P 9b3367a5854f49b98da54556a209b0de: ending tablet copy session fbfdeb011a604f78a77f04be26573717-10e7dc78d083418c9f49bb4450d426f7 on tablet 10e7dc78d083418c9f49bb4450d426f7 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:29.286566 2320 raft_consensus.cc:1217] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:29.352792 2320 raft_consensus.cc:1217] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:29.491648 2320 raft_consensus.cc:1217] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:29.528908 2320 raft_consensus.cc:1217] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:29.721256 2499 raft_consensus.cc:1064] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:29.723198 2499 consensus_queue.cc:237] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:29.734112 2320 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:29.735430 1788 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:29.736817 2499 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:29.736910 1644 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:29.737862 2520 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:29.738603 2519 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:29.744233 2521 raft_consensus.cc:1064] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:29.746623 2521 consensus_queue.cc:237] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:29.750140 2499 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.752115 1788 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.758895 2320 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:29.762270 2457 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:29.762678 1644 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.766047 1717 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:29.769304 2457 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:29.773311 1792 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:29.777030 2521 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:29.780742 2318 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.798483 1544 catalog_manager.cc:5654] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.804983 2488 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.815272 2320 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.834764 1721 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.835235 1791 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.865299 1721 consensus_queue.cc:237] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:29.870136 1541 catalog_manager.cc:5654] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.870697 1791 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:29.873270 2320 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:29.873489 2520 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:29.874661 2519 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:29.880921 2519 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.886263 2320 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.902994 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 86d34bd4c9884678a883bfc6fe5393a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:29.927702 1644 consensus_queue.cc:237] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:29.934118 1718 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:29.932802 1543 catalog_manager.cc:5654] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.937135 2457 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:29.937985 2320 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:29.938241 1791 raft_consensus.cc:2955] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.939337 2457 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:29.948282 2521 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.954216 1636 tablet_service.cc:1552] Processing DeleteTablet for tablet 86d34bd4c9884678a883bfc6fe5393a8 with delete_type TABLET_DATA_TOMBSTONED (TS 9b3367a5854f49b98da54556a209b0de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43794
I20251215 20:52:29.955760 2320 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.964766 2532 raft_consensus.cc:1064] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:29.967041 2532 consensus_queue.cc:237] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:29.970052 2538 tablet_replica.cc:333] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:29.972517 2538 raft_consensus.cc:2243] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:29.973277 2538 raft_consensus.cc:2272] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:29.975692 1543 catalog_manager.cc:5654] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.977049 1530 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet cffb60a2970e4e049f29999509c860aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:29.970189 1718 raft_consensus.cc:2955] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:29.985927 2538 ts_tablet_manager.cc:1916] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:29.995792 1791 raft_consensus.cc:1275] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:29.997483 2320 raft_consensus.cc:1275] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:29.997278 2521 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:30.000900 1718 raft_consensus.cc:1275] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:30.003189 2457 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:30.004328 2521 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:30.009479 1782 tablet_service.cc:1552] Processing DeleteTablet for tablet cffb60a2970e4e049f29999509c860aa with delete_type TABLET_DATA_TOMBSTONED (TS 95847161b0414d4e92d6cab94956fa57 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46036
I20251215 20:52:30.012866 2538 ts_tablet_manager.cc:1929] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:30.013361 2538 log.cc:1199] T 86d34bd4c9884678a883bfc6fe5393a8 P 9b3367a5854f49b98da54556a209b0de: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-0-root/wals/86d34bd4c9884678a883bfc6fe5393a8
I20251215 20:52:30.022177 2542 tablet_replica.cc:333] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:52:30.022543 1530 catalog_manager.cc:4985] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): tablet 86d34bd4c9884678a883bfc6fe5393a8 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:30.025146 2542 raft_consensus.cc:2243] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:30.026556 2457 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.027957 2542 raft_consensus.cc:2272] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:30.027635 2318 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.029510 1718 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.031522 2542 ts_tablet_manager.cc:1916] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:30.037160 1791 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.050503 1543 catalog_manager.cc:5654] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:30.058538 2542 ts_tablet_manager.cc:1929] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:30.059600 2542 log.cc:1199] T cffb60a2970e4e049f29999509c860aa P 95847161b0414d4e92d6cab94956fa57: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root/wals/cffb60a2970e4e049f29999509c860aa
I20251215 20:52:30.061206 1531 catalog_manager.cc:4985] TS 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): tablet cffb60a2970e4e049f29999509c860aa (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:30.080488 1641 consensus_queue.cc:237] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:30.087503 1718 raft_consensus.cc:1275] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:30.087584 2488 raft_consensus.cc:1064] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:30.089920 2488 consensus_queue.cc:237] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:30.090430 2457 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251215 20:52:30.097442 2318 raft_consensus.cc:1275] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:30.099509 2532 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.102058 2545 consensus_queue.cc:1050] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:30.102941 1717 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.107156 2318 raft_consensus.cc:2955] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.112957 1530 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 10e7dc78d083418c9f49bb4450d426f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:30.118695 2320 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:30.119421 1791 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:30.120663 1717 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:30.120713 2545 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:30.123998 1543 catalog_manager.cc:5654] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 3 to 4, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.122157 2488 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20251215 20:52:30.126026 2545 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:30.136788 1782 tablet_service.cc:1552] Processing DeleteTablet for tablet 10e7dc78d083418c9f49bb4450d426f7 with delete_type TABLET_DATA_TOMBSTONED (TS 95847161b0414d4e92d6cab94956fa57 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46036
I20251215 20:52:30.137827 2542 tablet_replica.cc:333] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:52:30.138813 2542 raft_consensus.cc:2243] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:30.139559 2542 raft_consensus.cc:2272] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:30.143803 2542 ts_tablet_manager.cc:1916] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:30.151602 2521 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.154611 2320 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.156739 1718 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.169823 1543 catalog_manager.cc:5654] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.175872 1788 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.184811 2542 ts_tablet_manager.cc:1929] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:30.187577 2542 log.cc:1199] T 10e7dc78d083418c9f49bb4450d426f7 P 95847161b0414d4e92d6cab94956fa57: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root/wals/10e7dc78d083418c9f49bb4450d426f7
I20251215 20:52:30.190361 1531 catalog_manager.cc:4985] TS 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): tablet 10e7dc78d083418c9f49bb4450d426f7 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:30.205992 1641 consensus_queue.cc:237] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:30.209759 2320 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:30.210060 1791 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251215 20:52:30.211009 2532 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:30.212486 2532 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:30.217898 2521 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.219645 1791 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.221325 2319 raft_consensus.cc:2955] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:30.232393 1530 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet cbf9f34352854272976701e2b99044e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:30.242941 1542 catalog_manager.cc:5654] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de reported cstate change: config changed from index 3 to 4, VOTER be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:30.290999 1703 tablet_service.cc:1552] Processing DeleteTablet for tablet cbf9f34352854272976701e2b99044e6 with delete_type TABLET_DATA_TOMBSTONED (TS be5dd78ebc024aefa4d17b3ccf2ea1ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34122
I20251215 20:52:30.318207 2550 tablet_replica.cc:333] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:52:30.321521 2550 raft_consensus.cc:2243] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:30.325898 2550 raft_consensus.cc:2272] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:30.380797 2550 ts_tablet_manager.cc:1916] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:30.428161 2550 ts_tablet_manager.cc:1929] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251215 20:52:30.434979 2550 log.cc:1199] T cbf9f34352854272976701e2b99044e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-1-root/wals/cbf9f34352854272976701e2b99044e6
I20251215 20:52:30.440210 1531 catalog_manager.cc:4985] TS be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): tablet cbf9f34352854272976701e2b99044e6 (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:31.371776 1717 consensus_queue.cc:237] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:32.410189 1575 debug-util.cc:398] Leaking SignalData structure 0x7b080008baa0 after lost signal to thread 429
I20251215 20:52:32.434406 2561 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.440954 2561 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.450732 1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 760) took 1080 ms. Trace:
I20251215 20:52:32.451239 1644 rpcz_store.cc:276] 1215 20:52:31.370191 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:32.449886 (+1079695us) service_pool.cc:225] Handling call
1215 20:52:32.450203 (+ 317us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:32.450351 (+ 148us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:32.450375 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:32.450409 (+ 34us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:32.450436 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:32.450488 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:32.450577 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:32.453639 2565 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.456748 2565 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.456156 2567 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:32.459446 2567 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:32.461292 2565 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.461565 2567 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:32.465564 2561 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.479163 2570 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.479763 2570 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.481423 2568 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.481810 2570 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.482029 2568 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.484762 2545 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.485366 2565 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.485234 2545 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.484081 2568 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.487084 2545 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.489408 2571 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.485868 2507 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:52:32.486344 1575 debug-util.cc:398] Leaking SignalData structure 0x7b0800095ba0 after lost signal to thread 1578
I20251215 20:52:32.485821 2565 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.498140 2571 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:32.499627 1575 debug-util.cc:398] Leaking SignalData structure 0x7b0800095ae0 after lost signal to thread 1592
I20251215 20:52:32.500463 2507 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.501205 2545 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.501744 2545 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.502044 2568 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.491497 2562 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:32.519953 1575 debug-util.cc:398] Leaking SignalData structure 0x7b0800279fc0 after lost signal to thread 1670
I20251215 20:52:32.502595 2565 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:32.521106 1575 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb780 after lost signal to thread 1745
I20251215 20:52:32.507759 2481 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:52:32.522233 1575 debug-util.cc:398] Leaking SignalData structure 0x7b080030f0e0 after lost signal to thread 1819
I20251215 20:52:32.509063 2558 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.523020 2558 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:32.510524 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.512207 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.525149 2558 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:32.513105 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.522351 2481 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.510639 2560 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.526803 2560 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.507308 2568 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.529384 2481 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.527197 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.530407 2560 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.514650 2532 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.531219 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:32.531570 2571 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.531185 2532 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.533082 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.533810 2571 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.534655 2532 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.530709 2568 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:32.534070 1575 debug-util.cc:398] Leaking SignalData structure 0x7b0800324060 after lost signal to thread 2345
I20251215 20:52:32.538275 2481 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:32.535077 2571 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.538839 2481 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.540969 2481 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.541870 2545 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.542058 2568 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.542151 2560 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.542742 2568 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.543041 2560 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.543584 2571 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.542500 2559 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.516040 2561 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.541980 2558 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.545635 2561 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.546165 2558 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:32.547086 1684 consensus_peers.cc:597] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46f5d70a2d6346c498b6686a9f4cb1c9. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:32.547642 2561 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.547986 2558 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.514374 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.545578 2559 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:32.549079 1791 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:32.509991 2562 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.548838 2578 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:32.552012 2578 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:32.544914 2560 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.556727 2562 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.558095 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.558317 2566 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.558838 2566 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.561204 2561 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.561754 2561 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.563684 2561 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.544879 2568 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.550611 2559 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:32.515211 2507 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.567471 2567 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.568022 2567 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.568584 2568 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.569650 2568 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.574558 2578 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.570730 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.589762 1640 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:32.572693 2574 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:32.591137 2574 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.576264 2568 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.570252 2567 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.576946 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.578748 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.578918 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.597676 1639 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:32.579320 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.597244 1644 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:32.580367 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.580806 2566 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.578773 2581 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.581214 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.581544 1641 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:32.582404 2584 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.582801 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.583703 2577 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.584669 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.586259 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.608469 1788 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:32.588183 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.593410 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.595760 1794 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:32.602488 2317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:32.609746 1789 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:32.611227 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.615792 2575 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:32.611518 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.607708 2577 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:32.612399 2574 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.613128 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.613473 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.616276 2575 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.611162 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.614428 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.603994 2581 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.614380 2567 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.615080 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.629079 1760 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:32.629217 2569 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.630131 1760 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:32.628098 2567 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:32.631673 2559 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:32.632099 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.632339 2580 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:32.631470 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.634162 1760 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:32.632062 2559 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.635411 2559 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.626001 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.636348 1612 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:32.637511 2564 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:32.637883 2564 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.638222 2564 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.607982 2584 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:32.642985 2579 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:32.632833 2580 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.643611 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:32.643769 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.629670 2569 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.650169 2581 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.650466 1612 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:32.649217 2579 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.651386 1718 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:32.642429 2507 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:32.648347 1686 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:32.652604 2565 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.652931 2571 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:32.653321 2571 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.653365 2558 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.654490 2571 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.654172 2565 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.648844 2567 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:32.653505 2579 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.655968 2577 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.654641 2558 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.655591 1612 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:32.657145 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.657501 2561 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:32.658250 2561 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.658636 2561 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.659354 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.660379 2565 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.661175 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.664389 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.665324 2562 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.665835 2562 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.668200 2574 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.668406 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.669457 2562 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.670157 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.671614 2565 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.671775 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.659655 2558 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.672472 2565 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.673540 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.674396 2565 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.653795 2575 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.675117 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.653667 2507 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.652081 2569 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.675994 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.678061 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.663833 2579 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.678791 2567 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.678866 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.679343 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.679631 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.671747 2561 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.686475 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.686652 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.706822 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.675016 2571 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.655359 2581 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.706440 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.714008 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.716759 2580 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.717104 2584 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.715324 2561 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.718024 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.718132 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.712438 2559 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.724958 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.686405 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.727128 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.727545 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.721051 2564 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.720852 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.729396 2257 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.729828 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:32.730374 1791 raft_consensus.cc:1240] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:32.730774 2564 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.731437 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:32.731884 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.733042 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.736137 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:32.728652 2258 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.737282 2577 raft_consensus.cc:2749] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.737968 2577 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.738399 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.737275 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.740384 2579 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.740891 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:32.741359 2571 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.743041 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.743557 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.743916 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.743053 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.745028 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:32.745673 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.747010 2258 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.747166 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.748247 2577 raft_consensus.cc:2749] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.728763 2567 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.750283 2567 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.751420 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:32.754509 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:32.755674 1793 raft_consensus.cc:2393] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:32.751595 2559 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.752092 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.753258 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:32.757025 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.680352 2507 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:32.758401 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.758808 2575 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:32.760496 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.761775 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.763383 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.765381 1612 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.767019 2561 raft_consensus.cc:2749] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.768500 2580 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.769817 1612 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.770550 2561 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.771565 1612 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.772270 2561 raft_consensus.cc:2749] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.772090 1639 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:32.773051 2575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38100 (request call id 4) took 1403 ms. Trace:
I20251215 20:52:32.773425 1612 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:32.774268 1761 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.774554 2561 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:32.774935 2561 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:32.775081 2559 raft_consensus.cc:2749] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.775373 2561 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.776113 1761 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.777019 2564 raft_consensus.cc:2749] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.779841 1761 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.780512 2562 raft_consensus.cc:2749] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.785113 1612 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.784860 2566 consensus_queue.cc:1059] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:32.784284 1761 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.787123 2579 raft_consensus.cc:2749] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.786959 2507 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:32.787353 2562 raft_consensus.cc:2749] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.774159 2575 rpcz_store.cc:276] 1215 20:52:31.369197 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:31.369324 (+ 127us) service_pool.cc:225] Handling call
1215 20:52:31.379317 (+ 9993us) log.cc:844] Serialized 506 byte log entry
1215 20:52:32.772962 (+1393645us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3674,"raft.run_cpu_time_us":1536,"raft.run_wall_time_us":2478,"thread_start_us":13772,"threads_started":1,"wal-append.queue_time_us":12205,"wal-append.run_cpu_time_us":1734,"wal-append.run_wall_time_us":1028064}
I20251215 20:52:32.788113 1761 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.788954 2562 raft_consensus.cc:2749] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:32.789036 2566 raft_consensus.cc:3055] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:32.789512 2566 raft_consensus.cc:740] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:32.790408 1612 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.791113 2579 raft_consensus.cc:2749] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.790766 2566 consensus_queue.cc:260] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.791970 1761 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.792157 2566 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.784281 2561 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.795837 2561 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.796605 1544 catalog_manager.cc:5654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:32.797122 1792 consensus_queue.cc:237] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:32.792732 2562 raft_consensus.cc:2749] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.799692 1789 raft_consensus.cc:1240] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:32.793628 1687 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.801592 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:32.801785 2507 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:32.802543 2567 raft_consensus.cc:2749] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.803570 1687 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.804204 2567 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.806139 1687 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.806841 2567 raft_consensus.cc:2749] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.792094 1612 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.809830 2579 raft_consensus.cc:2749] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.810156 1687 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:32.811494 1612 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.812376 2579 raft_consensus.cc:2749] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.813319 2507 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.813534 1612 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.816370 2507 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.818148 1612 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.818707 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:32.819106 2507 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:32.819583 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:32.819727 2579 raft_consensus.cc:2749] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20251215 20:52:32.820454 1758 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8b4250dab5b409685b9c36ce1898c9b. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:32.820966 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:32.819176 1612 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.822656 1612 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.814705 1687 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.822846 1639 raft_consensus.cc:1275] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:32.819469 2561 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.813851 2567 raft_consensus.cc:2749] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.823909 2567 raft_consensus.cc:2749] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.824586 2568 raft_consensus.cc:2749] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.824904 1687 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.825127 2568 raft_consensus.cc:2749] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.825780 2585 raft_consensus.cc:2749] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.826251 2507 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.828058 1612 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.828763 2561 raft_consensus.cc:2749] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.826004 1687 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.831959 2585 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.833468 1687 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.834144 2585 raft_consensus.cc:2749] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.834187 2565 raft_consensus.cc:2955] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:32.835698 1639 raft_consensus.cc:2955] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:32.844095 1687 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.845849 2585 raft_consensus.cc:2749] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.847221 2585 consensus_queue.cc:1059] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.848455 2566 raft_consensus.cc:3055] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:32.848872 2566 raft_consensus.cc:740] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:32.849869 2566 consensus_queue.cc:260] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:32.852893 1639 consensus_queue.cc:237] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:32.855801 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.856065 1543 catalog_manager.cc:5654] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:32.860905 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.858068 2566 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:32.859026 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.859287 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.873013 2561 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:32.873603 2561 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.860625 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.860937 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.874828 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:32.873732 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:32.875461 2561 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:32.860231 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.876250 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:32.882301 1714 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:32.882961 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.884951 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:32.886759 1718 raft_consensus.cc:1275] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:32.887173 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:32.884976 1715 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:32.890594 1761 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.891032 1643 raft_consensus.cc:1240] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:32.891947 1761 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.892514 2558 raft_consensus.cc:2749] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.892938 2559 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.894996 1612 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.895910 1761 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:32.896502 2568 raft_consensus.cc:2749] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.897997 2562 raft_consensus.cc:2749] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.898793 1761 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.899334 2562 raft_consensus.cc:2749] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.899977 1761 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.900571 2562 raft_consensus.cc:2749] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.901137 1761 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.903744 2562 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.903302 1789 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:32.904788 1761 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.907477 2562 raft_consensus.cc:2749] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.906082 1761 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.909209 1761 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.909770 2562 raft_consensus.cc:2749] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.911949 2562 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:32.912536 2562 raft_consensus.cc:697] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:32.913453 2562 consensus_queue.cc:237] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.922091 2566 consensus_queue.cc:1059] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.928932 2585 raft_consensus.cc:3055] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:32.929343 2585 raft_consensus.cc:740] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:32.930145 2585 consensus_queue.cc:260] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.930920 1761 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:32.934543 2564 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:32.931447 2585 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.931844 2559 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.934868 1761 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:32.936033 2565 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:32.936502 2565 raft_consensus.cc:697] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:32.937384 2565 consensus_queue.cc:237] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:32.954367 1644 raft_consensus.cc:1240] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:32.956632 1793 raft_consensus.cc:1275] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:32.957947 1714 raft_consensus.cc:1275] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251215 20:52:32.958181 1609 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 668639c78eab435fb81c2471ddacf0db. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:32.959514 2580 consensus_queue.cc:1059] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.960590 2569 raft_consensus.cc:3055] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:32.960933 2569 raft_consensus.cc:740] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:32.961470 2568 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.961746 2569 consensus_queue.cc:260] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:32.961647 1715 raft_consensus.cc:2955] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:32.963032 2569 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:32.966012 2568 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.982151 2579 raft_consensus.cc:2955] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:32.985605 1543 catalog_manager.cc:5654] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:32.996035 1644 raft_consensus.cc:1240] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:32.999215 2564 consensus_queue.cc:1059] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:32.998651 1714 raft_consensus.cc:2955] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:33.000625 2564 raft_consensus.cc:3055] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:33.000958 2564 raft_consensus.cc:740] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:33.001794 2564 consensus_queue.cc:260] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:33.002835 2564 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:33.044502 1793 raft_consensus.cc:2955] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:33.048586 2600 ts_tablet_manager.cc:933] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:33.065151 1543 catalog_manager.cc:5654] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:33.070767 1641 consensus_queue.cc:237] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:33.072528 1542 catalog_manager.cc:5654] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 3, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:33.075639 2600 tablet_copy_client.cc:323] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:37421
I20251215 20:52:33.079751 1731 tablet_copy_service.cc:140] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Received BeginTabletCopySession request for tablet 46f5d70a2d6346c498b6686a9f4cb1c9 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38116)
I20251215 20:52:33.080317 1731 tablet_copy_service.cc:161] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Beginning new tablet copy session on tablet 46f5d70a2d6346c498b6686a9f4cb1c9 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38116: session id = fbfdeb011a604f78a77f04be26573717-46f5d70a2d6346c498b6686a9f4cb1c9
I20251215 20:52:33.092981 1731 tablet_copy_source_session.cc:215] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:33.098323 2600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f5d70a2d6346c498b6686a9f4cb1c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:52:33.112804 1609 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd752a241baf44c3aa4fda90213e209f. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:33.112901 1793 raft_consensus.cc:1275] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:33.114075 2561 consensus_queue.cc:1048] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:33.115079 1716 raft_consensus.cc:1275] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 20:52:33.117172 2561 consensus_queue.cc:1048] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:33.127141 2600 tablet_copy_client.cc:806] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:33.127828 2600 tablet_copy_client.cc:670] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:33.132809 2600 tablet_copy_client.cc:538] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:33.144963 2600 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:33.149816 2579 raft_consensus.cc:2955] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:33.156473 1716 raft_consensus.cc:2955] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:33.156915 1789 raft_consensus.cc:2955] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:33.172479 1544 catalog_manager.cc:5654] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index -1 to 2, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:33.208505 2600 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:33.209363 2600 tablet_bootstrap.cc:492] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:33.210026 2600 ts_tablet_manager.cc:1403] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.065s user 0.016s sys 0.013s
I20251215 20:52:33.212540 2600 raft_consensus.cc:359] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:33.213171 2600 raft_consensus.cc:740] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:33.213730 2600 consensus_queue.cc:260] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:33.216612 2600 ts_tablet_manager.cc:1434] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.006s user 0.005s sys 0.003s
I20251215 20:52:33.220525 1731 tablet_copy_service.cc:342] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-46f5d70a2d6346c498b6686a9f4cb1c9 received from {username='slave'} at 127.0.0.1:38116
I20251215 20:52:33.220942 1731 tablet_copy_service.cc:434] P be5dd78ebc024aefa4d17b3ccf2ea1ac: ending tablet copy session fbfdeb011a604f78a77f04be26573717-46f5d70a2d6346c498b6686a9f4cb1c9 on tablet 46f5d70a2d6346c498b6686a9f4cb1c9 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:33.282003 2600 ts_tablet_manager.cc:933] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:33.283836 2600 tablet_copy_client.cc:323] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:45401
I20251215 20:52:33.285465 1805 tablet_copy_service.cc:140] P 95847161b0414d4e92d6cab94956fa57: Received BeginTabletCopySession request for tablet f8b4250dab5b409685b9c36ce1898c9b from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38896)
I20251215 20:52:33.285988 1805 tablet_copy_service.cc:161] P 95847161b0414d4e92d6cab94956fa57: Beginning new tablet copy session on tablet f8b4250dab5b409685b9c36ce1898c9b from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38896: session id = fbfdeb011a604f78a77f04be26573717-f8b4250dab5b409685b9c36ce1898c9b
I20251215 20:52:33.296058 1805 tablet_copy_source_session.cc:215] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:33.301162 2600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b4250dab5b409685b9c36ce1898c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:33.330175 1714 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:33.331918 2565 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:34.155453 2610 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:34.156154 2610 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:34.158224 2610 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:34.199862 2600 tablet_copy_client.cc:806] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:34.200569 2600 tablet_copy_client.cc:670] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:34.202821 2613 ts_tablet_manager.cc:933] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:34.203884 2612 ts_tablet_manager.cc:933] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:34.261184 1644 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:34.540843 2609 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:34.541446 2609 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:34.543478 2609 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:34.559865 2613 tablet_copy_client.cc:323] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:38541
I20251215 20:52:34.562364 2612 tablet_copy_client.cc:323] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:38541
W20251215 20:52:34.665233 431 debug-util.cc:398] Leaking SignalData structure 0x7b080000fa80 after lost signal to thread 1714
I20251215 20:52:34.678591 1644 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20251215 20:52:34.665814 431 kernel_stack_watchdog.cc:198] Thread 1714 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 303ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20251215 20:52:34.733911 1760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s user 0.069s sys 0.219s
W20251215 20:52:34.811941 1760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s user 0.069s sys 0.219s
I20251215 20:52:34.812575 2615 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:34.813195 2615 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:34.815140 2615 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:34.649092 2609 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:34.777729 2611 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:34.778139 2610 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:34.815757 2616 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:34.904417 2623 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:34.878683 2615 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:34.905570 2620 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:34.920698 2615 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:34.923355 2615 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:34.894652 2622 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:34.896162 2609 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:34.930125 2609 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:34.930655 2609 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:34.931130 2609 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:34.908572 2610 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:34.938148 2610 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:34.908667 2611 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:34.946467 2623 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:34.948072 2621 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:34.907235 2616 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:34.945380 2615 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:34.954492 2611 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:34.955444 2621 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:34.956625 2609 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:34.947299 2610 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.204275 2621 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.204419 2611 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.204938 2611 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.205606 2621 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.206275 2621 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.206759 2611 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:35.207221 2611 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:35.207610 2611 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.208149 2621 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.212802 2610 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.213580 2616 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.214126 2616 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.214671 2610 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:34.953118 2619 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.028211 2623 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.215451 2619 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.215700 2615 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.203998 2609 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.217365 2619 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.214604 2616 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.217661 2615 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.219055 2609 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.222651 2609 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:34.942335 2620 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:35.232486 1714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.894s user 0.021s sys 0.007s
I20251215 20:52:35.238709 2616 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.244230 2620 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:35.244354 1714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.906s user 0.022s sys 0.007s
I20251215 20:52:34.947651 2622 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.253285 2631 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.254451 2636 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.254573 2632 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.256405 2615 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.256567 2624 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:35.258112 1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 679) took 1922 ms. Trace:
I20251215 20:52:35.259536 2623 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:34.777961 2561 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.261210 2624 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.261953 2610 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.261688 2623 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.261756 2615 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.259876 2611 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.263051 2634 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.284584 2634 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.285434 2638 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.286041 2638 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:35.261286 2625 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.293552 2622 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.293706 2627 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.265157 2623 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.265200 2624 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.266940 2615 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.268234 2621 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.286747 2634 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.285959 2640 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.267306 2616 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.281668 2561 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.314558 2633 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.315158 2561 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.289634 2611 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.315047 2633 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.310093 2624 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.315791 2611 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:35.316521 2624 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.260174 2631 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.317718 2611 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.261184 1714 rpcz_store.cc:276] 1215 20:52:33.336131 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:33.336749 (+ 618us) service_pool.cc:225] Handling call
1215 20:52:33.337049 (+ 300us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:33.337375 (+ 326us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:33.337403 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:33.337845 (+ 442us) log.cc:844] Serialized 26 byte log entry
1215 20:52:35.257669 (+1919824us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:35.257719 (+ 50us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:35.257812 (+ 93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:35.257858 (+ 46us) raft_consensus.cc:1685] finished
1215 20:52:35.257875 (+ 17us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:35.258019 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":533,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":1912860,"threads_started":1,"wal-append.queue_time_us":562857,"wal-append.run_cpu_time_us":1492,"wal-append.run_wall_time_us":1005233}
I20251215 20:52:35.318351 2624 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:35.312569 2615 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:35.318435 2616 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.319118 2615 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.293586 2635 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.296844 2629 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.297508 2622 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.308797 2623 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.291718 2610 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.317055 2633 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.281497 2632 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.326952 2609 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.318624 2631 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.294288 2627 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.288164 2636 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.326205 2621 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.356182 2630 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:35.413861 2611 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.451989 2645 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:35.294646 2625 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.346688 2624 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.357738 2634 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.346493 2628 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.392714 2639 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:35.415660 2633 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.345667 2622 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.356508 2623 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.320400 2640 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.346673 2629 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.525918 2611 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.350977 2635 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.418424 2609 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.571061 2642 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.571446 2626 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:35.574131 2637 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.529004 2624 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.588665 2643 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.568063 2620 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.543629 2645 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.595363 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.596746 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.600840 2638 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.602283 2625 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.603849 2636 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.605652 2640 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.346627 2616 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.541077 2630 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.639868 2630 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.560124 2634 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.590057 2615 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.589250 2643 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.659236 2654 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.661415 2654 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.663754 2654 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.660836 2653 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.577720 2633 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.666280 2654 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.666807 2654 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.565438 2639 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.682595 2639 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.567905 2628 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.685257 2628 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.691727 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.698167 2644 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.698390 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.614133 2620 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.698954 1645 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:35.705744 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.591929 2626 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.669478 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.691373 2633 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.732681 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.733271 1646 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:35.699704 2610 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.713198 2629 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.713760 2651 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.695366 2621 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.736658 2649 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.592191 2642 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.748733 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.749400 1646 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:35.739843 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.731174 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.721542 2636 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
W20251215 20:52:35.653705 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 237636us
I20251215 20:52:35.593806 2637 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.780759 1642 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:35.788820 2648 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.789371 2648 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.798043 2650 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.698724 2644 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.707551 2653 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.780726 2609 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:35.798585 2650 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.865221 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.781509 2622 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.941363 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:35.781412 2627 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:35.950253 1816 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd520 after lost signal to thread 429
W20251215 20:52:35.951229 1816 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1b40 after lost signal to thread 1578
I20251215 20:52:35.875214 2623 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.946575 2561 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.948407 1646 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:35.952308 2561 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.790079 2632 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.876150 2624 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.957834 2641 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.799186 2611 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.899793 2634 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.899816 2620 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.961645 2648 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:35.961588 2623 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.961953 2637 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:35.962759 2642 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.966183 2642 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:35.966614 2642 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.968634 2642 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.790429 1638 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:35.969123 2642 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.969275 2561 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.965263 2623 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.954879 2622 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.960879 2654 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:35.790025 2636 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:35.971961 2637 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.969781 2642 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:35.979398 431 debug-util.cc:398] Leaking SignalData structure 0x7b080000f720 after lost signal to thread 1714
I20251215 20:52:35.974460 2622 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.781730 2651 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.976907 2654 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.976979 2620 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:35.782527 2649 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.993563 2644 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:35.987130 2620 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:35.987242 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:35.969882 2641 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.022163 2631 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:35.994186 2654 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:35.981221 2637 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.022018 2644 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.035720 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.035943 2650 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.037777 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.037873 2653 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.039075 2622 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.039177 2644 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.045346 1714 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.136106 2651 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.136631 2642 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.140558 1612 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.137002 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.136729 2651 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.035146 2631 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.166555 1714 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.174944 2652 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.175380 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.177290 1612 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.122502 2609 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.150512 2561 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.106976 2653 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.175598 2652 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.182137 2659 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.182592 2561 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.176122 1714 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.152724 2623 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.137269 2642 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.122020 2656 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.198282 2662 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.194368 2609 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.202746 1612 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.182796 2650 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.198940 2561 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.199751 2620 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.226033 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.209403 2631 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:36.193424 2649 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.196789 2622 raft_consensus.cc:2804] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.191422 2653 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.174044 2651 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:36.206912 2641 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.224370 2655 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.280460 2656 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:36.280808 2655 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.282527 2656 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.283038 2656 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.283783 2656 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.193622 2658 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.209962 2610 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.205566 2659 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:36.270810 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 68152.6us
I20251215 20:52:36.228845 2654 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.275015 2611 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.296808 2611 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.297245 2611 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.277981 2661 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.280186 2653 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.298111 1656 tablet_copy_service.cc:140] P 9b3367a5854f49b98da54556a209b0de: Received BeginTabletCopySession request for tablet cd752a241baf44c3aa4fda90213e209f from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:59670)
I20251215 20:52:36.284044 2651 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.282781 2655 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.049217 2657 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.280223 2609 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:36.279403 2663 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.278908 2642 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.280007 2662 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.310819 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.277021 2650 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.289587 2644 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.293881 2658 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.293990 2610 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.313354 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.298759 1655 tablet_copy_service.cc:140] P 9b3367a5854f49b98da54556a209b0de: Received BeginTabletCopySession request for tablet 668639c78eab435fb81c2471ddacf0db from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:59670)
I20251215 20:52:36.298481 2661 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.310400 1656 tablet_copy_service.cc:161] P 9b3367a5854f49b98da54556a209b0de: Beginning new tablet copy session on tablet cd752a241baf44c3aa4fda90213e209f from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:59670: session id = fbfdeb011a604f78a77f04be26573717-cd752a241baf44c3aa4fda90213e209f
I20251215 20:52:36.314414 1638 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:36.277385 2620 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.314193 2657 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.311968 2663 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.317770 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.335225 1655 tablet_copy_service.cc:161] P 9b3367a5854f49b98da54556a209b0de: Beginning new tablet copy session on tablet 668639c78eab435fb81c2471ddacf0db from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:59670: session id = fbfdeb011a604f78a77f04be26573717-668639c78eab435fb81c2471ddacf0db
I20251215 20:52:36.343315 2610 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.345407 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.318048 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:36.277604 2622 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.230063 2637 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.353505 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:36.353835 2661 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.355165 2320 raft_consensus.cc:2468] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.357123 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.357748 2650 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.327773 2620 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.335019 1714 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.361570 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.363080 1638 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:36.359414 2664 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.366768 2657 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.364745 1637 raft_consensus.cc:2468] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:36.368183 2642 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.368989 2663 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.364056 2664 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.354882 2622 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.359091 2631 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.374207 1612 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.380412 2610 raft_consensus.cc:2804] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.386123 2610 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.386654 2610 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.360368 2319 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.390986 1609 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.385649 2664 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.391836 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:36.394521 2316 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.398329 2656 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.390084 2652 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:36.400072 2641 raft_consensus.cc:2804] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.400471 2641 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.400827 2641 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.404376 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.404940 1655 tablet_copy_source_session.cc:215] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:36.405038 1714 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.406131 1612 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.406503 2620 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.407126 2623 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.407253 2658 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.407051 2641 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.408221 2623 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.408327 2257 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.408845 2623 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.409155 2663 raft_consensus.cc:2804] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.409380 2641 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:36.409530 2663 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.409993 2663 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.380577 2662 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.423345 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.424024 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.424589 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.428754 2620 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.429720 2620 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.431663 2620 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.406107 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.432996 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.425073 2658 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.434084 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.434669 1714 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.434497 2658 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.435555 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.436645 2658 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.437224 1612 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.437276 2659 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.438170 2641 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.438576 2641 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.438921 2641 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.445734 1656 tablet_copy_source_session.cc:215] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:36.385217 2631 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.449528 2631 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:36.452384 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 44149.2us
I20251215 20:52:36.452769 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:36.453411 2257 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.454164 2642 raft_consensus.cc:2804] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.454514 2642 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.454563 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:36.454922 2642 raft_consensus.cc:3060] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.455241 2316 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.470534 1684 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.467810 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:36.458519 2258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s user 0.000s sys 0.017s
I20251215 20:52:36.436148 1714 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.483951 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:36.478704 2258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s user 0.000s sys 0.018s
I20251215 20:52:36.484221 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.477603 2641 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.487635 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.459450 2561 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.489774 1791 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.478214 2656 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.479768 2257 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.487993 2319 raft_consensus.cc:1217] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
W20251215 20:52:36.491375 1758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s user 0.000s sys 0.023s
I20251215 20:52:36.498750 1612 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.542697 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:36.559914 1758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s user 0.000s sys 0.023s
I20251215 20:52:36.490821 1788 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.506987 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.547395 1645 raft_consensus.cc:1275] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:36.508267 2637 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.508107 2664 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.508426 2644 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.508278 2642 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.542172 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.562893 2669 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:36.521914 2663 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.541112 2641 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.571763 2669 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.507499 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.511143 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.482307 2668 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.567126 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.508550 2659 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.575300 2668 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.575579 2659 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.565498 2644 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.567116 2636 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.577559 2659 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.481087 2650 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.578102 2644 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.567107 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:36.560564 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 61912.9us
W20251215 20:52:36.568212 1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s user 0.036s sys 0.063s
I20251215 20:52:36.484616 2609 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.575523 1715 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.561525 2629 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.574962 1643 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
W20251215 20:52:36.579566 1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s user 0.036s sys 0.064s
I20251215 20:52:36.587980 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.595470 2629 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.596182 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.517942 2622 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.607617 1786 raft_consensus.cc:2468] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:36.608505 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.608841 2622 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:36.597091 1760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s user 0.024s sys 0.037s
I20251215 20:52:36.598583 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.570415 2616 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:36.611866 2616 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.612528 2643 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.613759 2616 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.601830 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.542441 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.614521 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.615159 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.615581 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:36.609403 1760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s user 0.024s sys 0.037s
I20251215 20:52:36.581881 2317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:36.616227 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 924781us
I20251215 20:52:36.606443 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.510074 2658 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.617642 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.609581 1717 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.612151 2645 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.622912 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.623225 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.522950 2623 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.615721 1795 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.563565 2637 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.565220 2664 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.618000 2658 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.629132 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.630280 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.641455 1795 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.642324 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.600051 2609 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.642758 2658 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:36.642763 1687 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34136 dropped due to backpressure: service queue is full with 50 items
I20251215 20:52:36.618935 1760 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:36.578332 2669 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.618026 2644 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20251215 20:52:36.619828 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.515290 2561 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.492033 2656 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.620220 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.606040 1789 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:36.514935 2626 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.596258 2642 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.584816 1714 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.582442 2657 raft_consensus.cc:2804] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.650223 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.615468 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.625176 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.578272 2650 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
W20251215 20:52:36.654141 1816 debug-util.cc:398] Leaking SignalData structure 0x7b080003fc00 after lost signal to thread 1670
I20251215 20:52:36.650537 2644 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.654727 2644 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.610333 2629 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:36.655175 1816 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1ee0 after lost signal to thread 1745
W20251215 20:52:36.580914 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 106610us
I20251215 20:52:36.652781 2627 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.655810 2627 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.596230 2663 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.632148 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.587648 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.659462 1787 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:36.659847 2613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd752a241baf44c3aa4fda90213e209f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:36.632877 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.568048 2610 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.633097 1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 818) took 1054 ms. Trace:
I20251215 20:52:36.663023 1641 rpcz_store.cc:276] 1215 20:52:35.579119 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:35.579262 (+ 143us) service_pool.cc:225] Handling call
1215 20:52:35.579645 (+ 383us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:35.614572 (+ 34927us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:35.614599 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:35.614640 (+ 41us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:35.614664 (+ 24us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:36.632856 (+1018192us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400246654. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:36.632900 (+ 44us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:36.633018 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":79819520}
I20251215 20:52:36.610200 2611 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:36.623101 2668 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.609393 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.636601 1790 raft_consensus.cc:2468] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:36.637528 2637 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:36.638911 2664 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:36.640862 2635 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.664095 2258 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.674074 2663 raft_consensus.cc:2804] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.674446 2663 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.674794 2663 raft_consensus.cc:3060] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.642935 1795 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.675001 2258 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.675768 2642 raft_consensus.cc:2804] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.675917 2258 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:36.676144 2642 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.676729 2661 raft_consensus.cc:2749] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:36.677224 2258 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:36.678282 2661 raft_consensus.cc:2804] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.678651 2661 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:36.679013 2661 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.679152 2610 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.636663 2670 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.644235 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.676581 2642 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.645342 2609 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.645872 2320 raft_consensus.cc:1240] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:36.648391 1786 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.648111 2656 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.646703 2633 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.624271 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.652650 1788 raft_consensus.cc:2468] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.648479 2315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:36.676223 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.654827 1713 raft_consensus.cc:2393] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:36.656069 2650 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:36.627568 1612 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.630764 2623 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:36.689249 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 61706.7us
I20251215 20:52:36.685694 2600 tablet_copy_client.cc:538] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:36.657644 2627 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.655109 2644 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.689822 2610 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.661147 1760 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:36.661700 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.663607 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.662528 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:36.656215 1816 debug-util.cc:398] Leaking SignalData structure 0x7b08001540c0 after lost signal to thread 1819
I20251215 20:52:36.694307 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.694824 1717 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.694829 1791 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:36.664608 1686 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.665603 1609 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.665652 2318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:36.662623 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.667655 2612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668639c78eab435fb81c2471ddacf0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:36.653127 2657 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.667922 2611 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.643466 1687 service_pool.cc:138] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34136 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 688)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 565)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 566)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 567)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 569)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 591)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 681)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 683)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 684)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 685)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 686)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 690)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 691)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 693)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 597)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 697)
I20251215 20:52:36.669827 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.691165 2610 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.677450 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.679863 2670 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:36.680025 1712 raft_consensus.cc:2468] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.680662 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.688620 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.658167 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.690356 1612 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.691965 1760 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:36.693262 1544 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45274 (request call id 189) took 2284 ms. Trace:
I20251215 20:52:36.696336 1609 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:36.697337 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:36.719524 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:36.720328 2670 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:36.696364 2664 raft_consensus.cc:2804] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.720568 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.720131 1643 raft_consensus.cc:3060] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.721624 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.679443 2317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:36.709578 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.670315 1542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45280 (request call id 186) took 1165 ms. Trace:
I20251215 20:52:36.724642 2623 raft_consensus.cc:2804] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.710948 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.711808 1686 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.712842 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.713315 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.697685 2561 raft_consensus.cc:2804] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.714663 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.727793 1788 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.709107 2657 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.714854 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:36.714443 1793 raft_consensus.cc:2468] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.713587 2610 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.726677 1542 rpcz_store.cc:276] 1215 20:52:35.504897 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:35.505034 (+ 137us) service_pool.cc:225] Handling call
1215 20:52:36.670238 (+1165204us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20251215 20:52:36.735924 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.709162 2626 raft_consensus.cc:2804] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.726118 1612 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.727602 1717 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
W20251215 20:52:36.739655 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 47727us
I20251215 20:52:36.689462 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.727011 2623 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.724793 2664 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.745040 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.728425 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:36.730382 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.731849 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.732281 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.745867 1645 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:36.732870 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.728447 2561 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.732897 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.735220 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.693213 2633 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.761849 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.762240 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:36.762897 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.723172 1544 rpcz_store.cc:276] 1215 20:52:34.409306 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:34.952628 (+543322us) service_pool.cc:225] Handling call
1215 20:52:36.693205 (+1740577us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28901,"reported_tablets":5}
I20251215 20:52:36.724921 1609 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:36.727331 2634 raft_consensus.cc:2804] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.743527 2670 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.758978 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.746168 2659 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.746970 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.804018 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.729555 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.756665 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.801162 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.757642 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.759639 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.759662 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.760968 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.761197 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.741977 2626 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.745797 1718 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.796772 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.767256 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.763551 2641 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.760571 1760 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:36.797616 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.727159 1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 556) took 1018 ms. Trace:
I20251215 20:52:36.757350 1716 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.763840 2561 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.747232 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.814837 1646 raft_consensus.cc:2393] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:36.814402 1639 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:36.814803 1644 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:36.742758 1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 555) took 1045 ms. Trace:
I20251215 20:52:36.821002 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:36.820961 1609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 96114.3us
I20251215 20:52:36.819263 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.821220 2626 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.747337 2664 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:36.760528 1816 debug-util.cc:398] Leaking SignalData structure 0x7b08003265a0 after lost signal to thread 2345
I20251215 20:52:36.800688 2634 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.746706 2623 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:36.825476 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 64948.4us
I20251215 20:52:36.849098 1760 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:36.771098 1612 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.811677 2659 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.826807 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.830520 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.797570 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.850418 1788 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.837363 1792 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:36.841650 1718 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:36.820214 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.821523 2641 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.847815 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.823367 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.828783 2647 raft_consensus.cc:2804] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251215 20:52:36.849920 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 78903.3us
I20251215 20:52:36.856950 1612 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.857592 1612 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:36.858071 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.858711 1717 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.859668 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.860179 1719 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:36.857512 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.834189 1713 rpcz_store.cc:276] 1215 20:52:35.697167 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:35.717506 (+ 20339us) service_pool.cc:225] Handling call
1215 20:52:36.625469 (+907963us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:36.733830 (+108361us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b5400208ad4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:36.740932 (+ 7102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":60348928}
I20251215 20:52:36.836885 1787 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:36.864565 1718 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:36.865705 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.872886 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.873729 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.866519 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.866820 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.869554 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.869902 2633 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:36.862366 1714 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:36.854598 2636 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.875509 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.852254 2659 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.861121 2647 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.877823 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.854879 2631 raft_consensus.cc:2804] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.848506 2634 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.878764 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.853830 2641 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.879930 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.881314 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.880649 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.884575 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.886168 2663 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:36.861961 2622 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:36.827641 1712 rpcz_store.cc:276] 1215 20:52:35.707002 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:35.737239 (+ 30237us) service_pool.cc:225] Handling call
1215 20:52:36.643377 (+906138us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:36.725307 (+ 81930us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4377344}
I20251215 20:52:36.892975 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.895933 1719 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:36.876313 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:36.871269 2660 consensus_queue.cc:1048] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20251215 20:52:36.881160 2636 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.922619 2636 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.892619 2647 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.927424 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.928046 1721 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:36.942031 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.942297 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.942761 1717 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:36.942982 1718 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:36.943514 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 568) took 1043 ms. Trace:
I20251215 20:52:36.893570 2631 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:36.894276 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:36.942301 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.945019 2318 raft_consensus.cc:2393] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:36.943811 1718 rpcz_store.cc:276] 1215 20:52:35.900206 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.917408 (+1017202us) service_pool.cc:225] Handling call
1215 20:52:36.943461 (+ 26053us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26240}
I20251215 20:52:36.901525 2622 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:36.954948 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.927071 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:36.950309 2631 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.080658 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.080318 2317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:37.179283 1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 566) took 1182 ms. Trace:
I20251215 20:52:37.179644 1717 rpcz_store.cc:276] 1215 20:52:35.899684 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.951824 (+1052140us) service_pool.cc:225] Handling call
1215 20:52:37.081347 (+129523us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.081512 (+ 165us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:37.081539 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:37.081578 (+ 39us) raft_consensus.cc:1645] Marking committed up to 4
1215 20:52:37.081609 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:37.081659 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:37.081760 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:37.178170 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 567) took 1197 ms. Trace:
I20251215 20:52:36.954078 2622 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:36.949939 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:36.951967 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.178282 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 569) took 1180 ms. Trace:
I20251215 20:52:36.954536 1716 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.180459 1718 rpcz_store.cc:276] 1215 20:52:35.899953 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.955480 (+1055527us) service_pool.cc:225] Handling call
1215 20:52:37.096612 (+141132us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.096778 (+ 166us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:37.096804 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:37.096855 (+ 51us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:37.096884 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:37.096934 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:37.097046 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:37.186374 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.187858 1719 rpcz_store.cc:276] 1215 20:52:35.900472 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.953145 (+1052673us) service_pool.cc:225] Handling call
1215 20:52:37.080641 (+127496us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.080819 (+ 178us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:37.080844 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:37.080883 (+ 39us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:37.080908 (+ 25us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:37.080958 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:37.081074 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1644416}
I20251215 20:52:37.192605 2627 raft_consensus.cc:1064] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:37.195851 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.195178 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.197201 1717 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:37.201926 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.194977 2674 raft_consensus.cc:2804] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:37.205902 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.198899 2315 raft_consensus.cc:1240] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.207439 1719 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:37.208967 1718 raft_consensus.cc:1275] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:37.207427 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.211102 1717 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:37.206563 2674 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
W20251215 20:52:37.205235 2661 consensus_meta.cc:287] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Time spent flushing consensus metadata: real 0.526s user 0.008s sys 0.012s
I20251215 20:52:37.235711 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:37.236362 1787 raft_consensus.cc:3060] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.224913 2674 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.228936 2663 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.232715 2661 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:37.242336 2644 consensus_meta.cc:287] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.551s user 0.021s sys 0.008s
I20251215 20:52:37.252485 2641 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.252868 2622 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.256506 2622 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.257862 2623 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.258558 2659 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:37.262655 2656 consensus_meta.cc:287] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.556s user 0.002s sys 0.003s
I20251215 20:52:37.262980 2656 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.263180 2631 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.245473 2644 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:37.267313 2657 consensus_meta.cc:287] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: Time spent flushing consensus metadata: real 0.526s user 0.003s sys 0.005s
W20251215 20:52:37.267591 2629 consensus_meta.cc:287] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.612s user 0.007s sys 0.008s
I20251215 20:52:37.267701 2657 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.268085 2629 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:37.268738 2642 consensus_meta.cc:287] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: Time spent flushing consensus metadata: real 0.559s user 0.004s sys 0.004s
I20251215 20:52:37.273813 2642 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.274832 1718 raft_consensus.cc:1240] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.269764 2634 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.276713 2659 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:37.277659 2600 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:37.278425 1795 raft_consensus.cc:2393] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:37.281109 2647 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.283042 2647 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:37.271826 2610 consensus_meta.cc:287] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.528s user 0.007s sys 0.001s
I20251215 20:52:37.318912 2314 raft_consensus.cc:1240] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.278024 2644 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:37.248342 2627 consensus_queue.cc:237] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.327023 2664 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.275756 2623 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.339442 2674 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.345065 2641 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.350549 2657 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.351034 2629 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.355890 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:37.320034 2656 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:37.364387 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:37.369650 2626 consensus_meta.cc:287] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.519s user 0.011s sys 0.000s
I20251215 20:52:37.370029 2626 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.372010 2626 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.320276 2610 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.374701 2610 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.358577 2642 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.377310 2664 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:37.381289 2674 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:37.389448 2561 consensus_meta.cc:287] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.541s user 0.024s sys 0.016s
I20251215 20:52:37.389896 2561 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.394447 2561 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:37.359522 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:37.395917 1793 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.398821 2613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53416 (request call id 65) took 3284 ms. Trace:
I20251215 20:52:37.344022 2636 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.348093 2661 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.401710 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:37.392060 1787 raft_consensus.cc:2468] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:37.410841 2314 raft_consensus.cc:2393] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:37.410007 2631 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:37.414897 2258 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:37.420873 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.424754 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.431069 2661 raft_consensus.cc:2804] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:37.434263 2636 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.441045 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.442137 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.443944 1646 raft_consensus.cc:2393] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:37.399219 2613 rpcz_store.cc:276] 1215 20:52:34.114731 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:34.114881 (+ 150us) service_pool.cc:225] Handling call
1215 20:52:34.216506 (+101625us) ts_tablet_manager.cc:934] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
1215 20:52:36.657402 (+2440896us) tablet_copy_client.cc:368] Tablet copy session begun
1215 20:52:37.382002 (+724600us) tablet_metadata.cc:641] Metadata flushed
1215 20:52:37.382261 (+ 259us) tablet_copy_client.cc:497] Wrote new tablet metadata
1215 20:52:37.398106 (+ 15845us) tablet_copy_client.cc:418] Wrote new consensus metadata
1215 20:52:37.398408 (+ 302us) tablet_replica.cc:206] Creating consensus instance
1215 20:52:37.398690 (+ 282us) ts_tablet_manager.cc:989] Replica registered.
1215 20:52:37.398745 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":149574,"tablet-copy.queue_time_us":87434,"thread_start_us":281996,"threads_started":2}
I20251215 20:52:37.444576 1793 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:37.445557 2613 tablet_copy_client.cc:806] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:37.446100 2613 tablet_copy_client.cc:670] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:37.445973 2258 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:37.446882 2642 raft_consensus.cc:2804] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:37.447348 2642 raft_consensus.cc:697] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:37.448210 2642 consensus_queue.cc:237] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.453419 2634 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:37.453661 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:37.455507 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.458115 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.458796 1646 raft_consensus.cc:2393] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:37.459805 1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 565) took 1562 ms. Trace:
I20251215 20:52:37.460180 1712 rpcz_store.cc:276] 1215 20:52:35.897412 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.926456 (+1029044us) service_pool.cc:225] Handling call
1215 20:52:37.187661 (+261205us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.196374 (+ 8713us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:37.198317 (+ 1943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:37.200336 (+ 2019us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:37.203792 (+ 3456us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:37.206091 (+ 2299us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:37.459742 (+253651us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:37.199234 1713 raft_consensus.cc:2468] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:37.469460 2600 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:37.470358 2600 tablet_bootstrap.cc:492] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:37.471001 2600 ts_tablet_manager.cc:1403] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.194s user 0.039s sys 0.037s
I20251215 20:52:37.441574 2661 raft_consensus.cc:697] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:37.477286 2661 consensus_queue.cc:237] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.480149 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.472594 2612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53416 (request call id 67) took 3348 ms. Trace:
I20251215 20:52:37.484685 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.494845 1646 raft_consensus.cc:2393] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:37.495949 1646 raft_consensus.cc:1240] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.485324 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.497363 1644 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:37.485893 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:37.488721 2612 rpcz_store.cc:276] 1215 20:52:34.124003 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:34.124133 (+ 130us) service_pool.cc:225] Handling call
1215 20:52:34.218533 (+ 94400us) ts_tablet_manager.cc:934] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
1215 20:52:36.660256 (+2441723us) tablet_copy_client.cc:368] Tablet copy session begun
1215 20:52:37.270358 (+610102us) tablet_metadata.cc:641] Metadata flushed
1215 20:52:37.270587 (+ 229us) tablet_copy_client.cc:497] Wrote new tablet metadata
1215 20:52:37.434374 (+163787us) tablet_copy_client.cc:418] Wrote new consensus metadata
1215 20:52:37.434726 (+ 352us) tablet_replica.cc:206] Creating consensus instance
1215 20:52:37.466316 (+ 31590us) ts_tablet_manager.cc:989] Replica registered.
1215 20:52:37.472048 (+ 5732us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":154550,"tablet-copy.queue_time_us":79236,"thread_start_us":278367,"threads_started":2}
I20251215 20:52:37.482642 1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 591) took 1494 ms. Trace:
I20251215 20:52:37.550655 2612 tablet_copy_client.cc:806] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:37.551483 2612 tablet_copy_client.cc:670] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:37.484002 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.553686 1642 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:37.550662 1721 rpcz_store.cc:276] 1215 20:52:35.987994 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:37.203247 (+1215253us) service_pool.cc:225] Handling call
1215 20:52:37.481404 (+278157us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.481572 (+ 168us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:37.481598 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:37.481635 (+ 37us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:37.481662 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:37.481711 (+ 49us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:37.482450 (+ 739us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540009c9d0. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfa52d 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:37.482566 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":623190912}
I20251215 20:52:37.493628 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.482679 1716 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:37.557379 1637 raft_consensus.cc:2393] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:37.557739 1714 raft_consensus.cc:1240] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.568313 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.568364 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.568713 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.569214 1642 raft_consensus.cc:2468] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:37.569376 1646 raft_consensus.cc:2468] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:37.570806 1786 raft_consensus.cc:1240] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.570959 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.571509 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.571655 1642 raft_consensus.cc:2468] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:37.572976 1642 raft_consensus.cc:1240] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.573081 1644 raft_consensus.cc:1240] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.573974 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.574112 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.574790 1642 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:37.574891 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.575740 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.575881 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.576433 1642 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:37.576660 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.576884 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.577279 1637 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:37.576228 1686 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.581264 1686 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.582049 1686 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.583050 1686 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:37.593658 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.594658 2680 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:37.595077 2680 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:37.595412 2680 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:37.595638 1642 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:37.597676 1686 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:37.593135 1643 consensus_meta.cc:287] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.872s user 0.020s sys 0.010s
I20251215 20:52:37.600507 1643 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:37.601172 1638 raft_consensus.cc:1240] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.600255 1791 raft_consensus.cc:1240] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.606778 2680 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:37.608970 1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s user 0.035s sys 0.020s
W20251215 20:52:37.609355 1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s user 0.035s sys 0.020s
W20251215 20:52:37.609607 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 751917us
I20251215 20:52:37.610196 1612 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.610925 2674 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:37.611356 2674 raft_consensus.cc:697] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:37.612210 2674 consensus_queue.cc:237] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.615288 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.615926 1644 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:37.616371 1612 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.617375 1612 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.618070 1612 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.618196 2257 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:37.618777 1612 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.619516 1612 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.620216 1612 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.621412 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:37.622288 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:37.622639 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:37.623641 1638 raft_consensus.cc:2393] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:37.624506 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:37.623077 1643 raft_consensus.cc:2393] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:37.625445 2257 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:37.626503 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:37.627269 1643 raft_consensus.cc:1240] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.628345 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:37.621047 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:37.630833 1640 raft_consensus.cc:1240] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.637300 1640 raft_consensus.cc:1240] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.635995 1642 raft_consensus.cc:1240] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.638420 1640 raft_consensus.cc:1240] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.639578 1640 raft_consensus.cc:1240] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.641417 1642 raft_consensus.cc:1240] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.633673 1639 raft_consensus.cc:1240] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.632109 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:37.643333 1640 raft_consensus.cc:1240] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.648878 2318 raft_consensus.cc:1240] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.652474 1640 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:37.608965 2680 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.658340 2685 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:37.658818 2685 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:37.659211 2685 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:37.632038 1643 raft_consensus.cc:1240] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.660666 2674 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:37.661219 2674 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:37.661612 2674 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:37.660667 1640 raft_consensus.cc:1240] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.587917 2679 consensus_queue.cc:1059] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20251215 20:52:37.660266 2688 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:37.663998 2679 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:37.636034 2684 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:37.667222 2685 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.668491 2686 raft_consensus.cc:2804] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:37.677593 2685 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.678293 2685 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:37.678670 2685 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:37.669435 2688 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:37.669566 2679 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:52:37.805800 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 206424us
I20251215 20:52:37.679363 2680 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:37.808844 1686 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:37.808137 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:37.674930 2684 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:37.811772 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.679035 2685 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:37.675971 2686 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:37.819434 2686 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.807862 2688 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:37.808135 2679 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:37.819329 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.821986 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.822338 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.822472 1721 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.819360 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.819700 2674 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:37.817662 1612 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.522s (SENT) [suppressed 1 similar messages]
I20251215 20:52:37.817111 2684 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.820050 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.829599 2682 raft_consensus.cc:2749] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:37.831576 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.830744 2681 raft_consensus.cc:3055] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:37.832552 2680 consensus_queue.cc:1059] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:37.836669 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.838469 2685 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.840888 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.841871 1716 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.843586 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.847213 1719 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.835793 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.825659 2690 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:37.840035 2688 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.861601 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.841354 2681 raft_consensus.cc:740] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:37.869329 2681 consensus_queue.cc:260] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.871958 2681 raft_consensus.cc:3060] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.875099 1718 raft_consensus.cc:2393] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:37.862936 2682 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:37.863175 2690 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:37.884474 2690 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:37.865203 1713 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.870527 2674 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.879699 2682 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:37.888154 2682 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.893425 1716 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:37.897897 2657 raft_consensus.cc:2804] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:37.902184 2685 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.912047 2320 raft_consensus.cc:1240] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.912216 2681 raft_consensus.cc:3055] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:37.912261 1721 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:37.915287 1719 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:37.916168 1638 raft_consensus.cc:3055] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:37.912575 2681 raft_consensus.cc:740] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:37.916663 1638 raft_consensus.cc:740] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:37.918125 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:37.919757 1638 consensus_queue.cc:260] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.920885 1638 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:37.922123 2679 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.920349 1717 raft_consensus.cc:1240] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.924362 1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 684) took 1350 ms. Trace:
I20251215 20:52:37.924676 1717 rpcz_store.cc:276] 1215 20:52:36.574039 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:37.919848 (+1345809us) service_pool.cc:225] Handling call
1215 20:52:37.920159 (+ 311us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.924144 (+ 3985us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:37.924310 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:37.933784 2684 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.940665 2688 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.901487 2691 raft_consensus.cc:2749] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20251215 20:52:37.965258 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 147814us
I20251215 20:52:37.945312 2679 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.966657 2681 consensus_queue.cc:260] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:37.976244 2681 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:37.976660 2642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s user 0.011s sys 0.019s
W20251215 20:52:37.977032 2642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s user 0.011s sys 0.019s
I20251215 20:52:37.968075 2684 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.968578 2611 raft_consensus.cc:2749] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:37.957229 2686 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.979573 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.980432 1795 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:37.980326 2316 raft_consensus.cc:1240] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:37.980336 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.981729 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:37.982523 2690 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.983958 1788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 559) took 1314 ms. Trace:
I20251215 20:52:37.986464 1786 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20251215 20:52:37.991298 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:37.992014 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 175006us
I20251215 20:52:37.993850 1717 raft_consensus.cc:2393] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:37.978540 2682 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:37.996515 1715 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:37.999081 2686 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:38.000687 1713 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:38.000599 2642 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:38.001981 2642 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:38.002636 2682 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:37.994247 1788 rpcz_store.cc:276] 1215 20:52:36.669446 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.875975 (+206529us) service_pool.cc:225] Handling call
1215 20:52:37.983337 (+1107362us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b5800002a98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0fe3e 000000000035a3c9 00007f30c2c3a560 00007f30c2d02dd4 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:37.983484 (+ 147us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.983642 (+ 158us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:37.983669 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:37.983707 (+ 38us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:37.983734 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:37.983782 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:37.983879 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7305984}
I20251215 20:52:38.008620 1686 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:38.010622 2638 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:38.008841 2681 consensus_queue.cc:1059] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20251215 20:52:38.011866 2638 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.012696 2681 raft_consensus.cc:3055] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:38.013057 2681 raft_consensus.cc:740] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:38.014218 2681 consensus_queue.cc:260] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:38.015475 2681 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.015369 1612 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:38.020130 1713 raft_consensus.cc:1240] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:38.020556 2684 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:38.021015 2684 raft_consensus.cc:697] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:38.021595 1719 raft_consensus.cc:1240] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:38.011068 2690 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:38.026069 1612 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:38.027499 2685 raft_consensus.cc:2749] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.029929 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.030733 1712 raft_consensus.cc:2393] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:38.031733 1715 raft_consensus.cc:1240] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:38.035959 1717 raft_consensus.cc:1240] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:38.035939 1612 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:37.989038 2657 raft_consensus.cc:697] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:38.021827 2684 consensus_queue.cc:237] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.038933 2657 consensus_queue.cc:237] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:38.057029 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:38.057632 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.039191 2682 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20251215 20:52:38.059791 2561 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:38.070499 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:38.072103 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:38.072875 1640 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:38.035283 2638 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:38.075927 1645 raft_consensus.cc:2393] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:38.081230 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:38.082089 1642 raft_consensus.cc:2393] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:38.082945 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:38.111856 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:38.113303 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.132472 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.085013 2561 raft_consensus.cc:697] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:38.134801 2561 consensus_queue.cc:237] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.168962 1612 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:38.176363 1612 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:38.176054 2674 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:38.183813 2685 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
W20251215 20:52:38.185319 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:38.246431 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 49751.7us
I20251215 20:52:38.252413 1612 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:38.257040 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.258430 1719 raft_consensus.cc:1275] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:38.258507 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.259209 1715 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 3
W20251215 20:52:38.246035 2697 log.cc:927] Time spent T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.067s user 0.003s sys 0.000s
W20251215 20:52:38.265470 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:38.272753 1760 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:38.292840 1760 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:38.291638 2638 raft_consensus.cc:2804] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.297778 2613 tablet_copy_client.cc:538] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:38.298086 2659 raft_consensus.cc:2804] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.298460 2659 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:38.298815 2659 raft_consensus.cc:3060] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.301931 2686 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:38.302415 2686 raft_consensus.cc:697] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:38.303200 2686 consensus_queue.cc:237] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.296397 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.297681 2638 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:38.305922 2638 raft_consensus.cc:3060] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.304997 1760 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:38.309001 2681 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:38.251375 2674 raft_consensus.cc:697] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:38.251227 2685 raft_consensus.cc:697] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:38.313776 2685 consensus_queue.cc:237] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:38.291208 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 206950us
I20251215 20:52:38.311357 1715 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
W20251215 20:52:38.317751 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 136394us
I20251215 20:52:38.320668 1761 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:38.332571 1687 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.333516 2674 consensus_queue.cc:237] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.337316 1612 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:38.339361 2679 raft_consensus.cc:2804] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.340019 2679 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:37.491299 2600 raft_consensus.cc:359] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:38.343887 2638 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.345340 2613 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:38.347301 1687 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.349845 1687 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.350579 2609 raft_consensus.cc:2749] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.354350 2619 raft_consensus.cc:2804] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.354779 2619 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:38.355150 2619 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.347080 2600 raft_consensus.cc:740] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:38.356447 1687 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.364251 1687 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.365396 1687 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.346956 2679 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.367656 1687 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.368789 1687 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.374429 2638 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:38.375128 2638 raft_consensus.cc:2804] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.375488 2638 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:38.375857 2638 raft_consensus.cc:3060] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.366619 2609 raft_consensus.cc:2749] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.370514 2635 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.382897 2635 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:38.383294 2635 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.377238 2627 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.379426 2633 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.381374 2694 raft_consensus.cc:2749] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.402063 2659 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.402576 2636 consensus_queue.cc:1048] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:38.362246 2600 consensus_queue.cc:260] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:38.404333 2636 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:38.404839 2636 raft_consensus.cc:697] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:38.404752 2631 consensus_queue.cc:1059] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:38.393167 2627 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:38.404114 2659 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:38.421030 2627 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.437124 2670 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:38.437652 2670 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.448092 1641 raft_consensus.cc:2393] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
W20251215 20:52:38.449451 1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59670 (request call id 24) took 1752 ms (client timeout 1656 ms). Trace:
W20251215 20:52:38.449819 1641 rpcz_store.cc:269] 1215 20:52:36.696990 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.697101 (+ 111us) service_pool.cc:225] Handling call
1215 20:52:38.449236 (+1752135us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400326254. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:38.449372 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3975133952}
I20251215 20:52:38.452250 2600 ts_tablet_manager.cc:1434] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.981s user 0.009s sys 0.015s
W20251215 20:52:38.452664 2600 ts_tablet_manager.cc:1467] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Tablet startup took 981ms
I20251215 20:52:38.453593 2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53414 (request call id 98) took 1571 ms. Trace:
I20251215 20:52:38.453961 2320 rpcz_store.cc:276] 1215 20:52:36.896718 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.900827 (+ 4109us) service_pool.cc:225] Handling call
1215 20:52:37.465011 (+564184us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.912545 (+447534us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:38.452751 (+540206us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54004682d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:38.453403 (+ 652us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54004682d0. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfa52d 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:38.453516 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2290506496}
I20251215 20:52:38.452174 1646 raft_consensus.cc:1240] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:38.458937 2645 consensus_queue.cc:1059] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251215 20:52:38.460328 2645 consensus_queue.cc:1243] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer fbfdeb011a604f78a77f04be26573717 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20251215 20:52:38.460817 2645 raft_consensus.cc:3055] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:38.461113 2645 raft_consensus.cc:740] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:38.462898 2645 consensus_queue.cc:260] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:38.464728 2645 raft_consensus.cc:3060] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.465090 2647 raft_consensus.cc:2749] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.472656 2647 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:38.473238 2647 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:38.440615 2659 consensus_queue.cc:1059] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20251215 20:52:38.427481 2636 consensus_queue.cc:237] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.464756 2315 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251215 20:52:38.531639 2682 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251215 20:52:38.537648 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:38.539215 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:38.542701 2635 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.547839 2647 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:38.554030 1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800168de0 after lost signal to thread 429
I20251215 20:52:38.573836 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.574498 1792 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:38.574911 1792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46054 (request call id 577) took 1620 ms. Trace:
I20251215 20:52:38.575181 1792 rpcz_store.cc:276] 1215 20:52:36.954435 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:38.558348 (+1603913us) service_pool.cc:225] Handling call
1215 20:52:38.574862 (+ 16514us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:38.505806 2679 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:38.584334 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 275465us
I20251215 20:52:38.601190 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:38.616849 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.616497 1760 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:38.620544 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 299908us
I20251215 20:52:38.620955 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:38.621764 1760 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:38.615885 2633 raft_consensus.cc:2749] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.627836 1761 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:38.628420 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.620384 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.636343 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.628235 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:38.631618 1742 debug-util.cc:398] Leaking SignalData structure 0x7b080016a4c0 after lost signal to thread 1578
I20251215 20:52:38.641346 2679 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:38.667452 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.634418 2635 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:38.642740 1787 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
W20251215 20:52:38.682207 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 60490.9us
I20251215 20:52:38.682608 2708 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.644731 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.668314 2631 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:38.684202 1760 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:38.668598 2705 raft_consensus.cc:3055] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:38.685531 1790 raft_consensus.cc:2393] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:38.691347 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:38.452922 2600 ts_tablet_manager.cc:1469] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Trace:
1215 20:52:33.280680 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:33.280782 (+ 102us) service_pool.cc:225] Handling call
1215 20:52:33.282261 (+ 1479us) ts_tablet_manager.cc:934] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
1215 20:52:33.300092 (+ 17831us) tablet_copy_client.cc:368] Tablet copy session begun
1215 20:52:33.898475 (+598383us) tablet_metadata.cc:641] Metadata flushed
1215 20:52:33.898760 (+ 285us) tablet_copy_client.cc:497] Wrote new tablet metadata
1215 20:52:34.198622 (+299862us) tablet_copy_client.cc:418] Wrote new consensus metadata
1215 20:52:34.198892 (+ 270us) tablet_replica.cc:206] Creating consensus instance
1215 20:52:34.199229 (+ 337us) ts_tablet_manager.cc:989] Replica registered.
1215 20:52:34.199300 (+ 71us) inbound_call.cc:173] Queueing success response
1215 20:52:37.277314 (+3078014us) ts_tablet_manager.cc:1379] Bootstrapping tablet
1215 20:52:37.471269 (+193955us) ts_tablet_manager.cc:1435] Starting tablet replica
1215 20:52:37.489009 (+ 17740us) tablet_replica.cc:261] Starting instrumentation
1215 20:52:37.489639 (+ 630us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":205,"mutex_wait_us":457,"raft.queue_time_us":2601,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"tablet-copy.queue_time_us":807,"tablet-download-pool.queue_time_us":71531,"tablet-download-pool.run_cpu_time_us":4397,"tablet-download-pool.run_wall_time_us":2398889,"thread_start_us":909,"threads_started":1}
I20251215 20:52:38.695183 1760 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:38.695600 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 67821.5us
I20251215 20:52:38.681536 2712 raft_consensus.cc:2749] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.696283 1761 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:38.687129 2631 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:52:38.784088 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:38.687829 2708 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:38.689985 2705 raft_consensus.cc:740] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:38.785591 2631 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:38.686128 2619 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:38.801152 2708 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.809635 2712 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20251215 20:52:38.836860 2707 log.cc:927] Time spent T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.147s user 0.000s sys 0.000s
I20251215 20:52:38.838361 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:38.839558 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:38.840345 1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s user 0.024s sys 0.078s
I20251215 20:52:38.811024 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.848709 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:38.841033 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 472229us
I20251215 20:52:38.841267 1641 raft_consensus.cc:2393] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
W20251215 20:52:38.842195 1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s user 0.024s sys 0.078s
W20251215 20:52:38.849900 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 511889us
I20251215 20:52:38.854082 1687 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.858179 1791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46050 (request call id 827) took 2261 ms. Trace:
I20251215 20:52:38.830246 2682 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:38.858561 1791 rpcz_store.cc:276] 1215 20:52:36.597017 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.820849 (+223832us) service_pool.cc:225] Handling call
1215 20:52:37.600058 (+779209us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.607099 (+ 7041us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:38.857998 (+1250899us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54000be5d0. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfa52d 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:38.858121 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1770848128}
I20251215 20:52:38.859115 2682 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.840648 2712 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:38.860183 2712 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:38.862160 1641 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:38.855962 1687 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.837442 2681 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:38.863826 1687 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.865957 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:38.867484 1641 raft_consensus.cc:2393] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:38.860821 2257 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.858179 1543 catalog_manager.cc:5654] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:38.869210 1687 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.870615 1687 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.860603 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:38.867916 2705 consensus_queue.cc:260] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.872457 1637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43800 (request call id 734) took 1292 ms. Trace:
I20251215 20:52:38.876504 2717 raft_consensus.cc:2804] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.876816 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.876961 2717 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:38.877334 2717 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.864279 2694 raft_consensus.cc:2804] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251215 20:52:38.871464 1742 debug-util.cc:398] Leaking SignalData structure 0x7b080025fe40 after lost signal to thread 1670
I20251215 20:52:38.868480 2681 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:38.861958 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.880479 1687 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:38.876713 2705 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.873100 2642 raft_consensus.cc:2749] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.873896 2656 raft_consensus.cc:2804] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:38.868676 2609 raft_consensus.cc:2804] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.902254 2609 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:38.902407 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.902752 2609 raft_consensus.cc:3060] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:38.888983 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 192707us
I20251215 20:52:38.879256 2682 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:38.879518 1637 rpcz_store.cc:276] 1215 20:52:37.580022 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:38.860318 (+1280296us) service_pool.cc:225] Handling call
1215 20:52:38.872397 (+ 12079us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:38.904918 1761 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:38.882601 2694 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:38.893525 2679 raft_consensus.cc:2804] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:38.905793 2612 tablet_copy_client.cc:538] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20251215 20:52:38.913326 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 95330.3us
I20251215 20:52:38.904156 2656 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:38.913058 2694 raft_consensus.cc:3060] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.912927 2679 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:38.881408 2627 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:38.928216 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.930702 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.931226 1716 raft_consensus.cc:2468] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:38.931943 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.932438 1716 raft_consensus.cc:2468] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:38.933158 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.934044 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.934517 1716 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:38.935197 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.906404 2657 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20251215 20:52:38.942010 1761 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:38.923331 2656 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:38.953749 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.954493 1719 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
W20251215 20:52:38.937716 2706 log.cc:927] Time spent T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.224s user 0.000s sys 0.001s
I20251215 20:52:38.926347 2633 raft_consensus.cc:2749] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:38.937347 1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 686) took 2354 ms. Trace:
I20251215 20:52:38.938241 2679 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:38.958861 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.972726 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.978595 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:38.979444 1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 688) took 2399 ms (client timeout 1998 ms). Trace:
W20251215 20:52:38.979789 1720 rpcz_store.cc:269] 1215 20:52:36.581166 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:36.812170 (+231004us) service_pool.cc:225] Handling call
1215 20:52:38.977094 (+2164924us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fdec 00007f30bac0f9ab 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:38.979352 (+ 2258us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8575104}
I20251215 20:52:38.980984 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.981578 1720 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:38.981961 1712 raft_consensus.cc:2468] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:38.982378 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:38.973008 1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800352960 after lost signal to thread 1745
I20251215 20:52:38.943899 2619 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:38.983006 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.983650 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.955747 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.984756 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.985162 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.985814 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.986335 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.986828 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.987476 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.987927 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.988574 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.988986 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.989552 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.978462 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.990124 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.990118 1791 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:38.991317 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:38.991570 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.992318 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.992815 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:38.993017 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.993263 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.993572 1786 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 3
I20251215 20:52:38.993947 1720 raft_consensus.cc:2468] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
W20251215 20:52:38.991362 1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800376b00 after lost signal to thread 1819
I20251215 20:52:38.993975 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:38.995186 1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800376b80 after lost signal to thread 1820
I20251215 20:52:38.994675 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:38.994802 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:39.000982 1720 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:38.972915 2724 consensus_queue.cc:1059] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20251215 20:52:39.001991 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:39.004842 1715 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:39.005931 2721 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.008317 1716 raft_consensus.cc:2468] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:39.009378 1715 raft_consensus.cc:1275] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:39.010473 1716 raft_consensus.cc:1240] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:39.011574 1719 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:39.012630 1719 raft_consensus.cc:1240] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:39.015961 2638 consensus_meta.cc:287] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.640s user 0.003s sys 0.010s
I20251215 20:52:39.016376 2638 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.018110 1789 raft_consensus.cc:2393] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
W20251215 20:52:39.015457 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 89596us
I20251215 20:52:39.004899 2718 raft_consensus.cc:2749] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:39.034432 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 93093us
I20251215 20:52:39.036068 1761 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:39.038254 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 619) took 1218 ms. Trace:
I20251215 20:52:39.014391 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:39.038600 1718 rpcz_store.cc:276] 1215 20:52:37.815997 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:37.842518 (+ 26521us) service_pool.cc:225] Handling call
1215 20:52:39.034070 (+1191552us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b54000e9a54. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:39.034200 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14266240}
I20251215 20:52:39.039985 1761 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:39.041199 1718 raft_consensus.cc:1275] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 20:52:39.041972 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:39.044353 2719 log.cc:927] Time spent T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.137s user 0.001s sys 0.000s
I20251215 20:52:39.048619 1718 raft_consensus.cc:1275] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:39.049902 1718 raft_consensus.cc:1240] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:39.051069 1718 raft_consensus.cc:1275] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:39.054551 2729 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.015053 2258 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:39.024762 2685 consensus_queue.cc:1059] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20251215 20:52:39.064026 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.065192 1788 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:39.066051 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.067005 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:38.969542 1714 rpcz_store.cc:276] 1215 20:52:36.574464 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:37.271163 (+696699us) service_pool.cc:225] Handling call
1215 20:52:37.557558 (+286395us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:37.558174 (+ 616us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:38.922975 (+1364801us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540023ee50. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfa52d 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:38.929321 (+ 6346us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":479423744}
I20251215 20:52:39.069273 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.072507 2718 consensus_queue.cc:1059] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251215 20:52:39.073238 1742 debug-util.cc:398] Leaking SignalData structure 0x7b080022f4a0 after lost signal to thread 2345
W20251215 20:52:39.073976 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 99629.4us
I20251215 20:52:39.074604 2642 raft_consensus.cc:2804] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:39.055226 2729 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:39.082031 2730 raft_consensus.cc:2749] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.042537 2684 consensus_queue.cc:1059] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20251215 20:52:39.033447 2720 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:39.054131 2724 consensus_queue.cc:1059] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20251215 20:52:39.055634 2629 consensus_queue.cc:1048] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20251215 20:52:39.096241 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.099826 1792 raft_consensus.cc:2468] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:39.085733 2642 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:39.087131 2729 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:39.091285 2718 raft_consensus.cc:3055] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.067626 2561 consensus_queue.cc:1048] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20251215 20:52:39.123867 2715 log.cc:927] Time spent T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.181s user 0.001s sys 0.001s
I20251215 20:52:39.086391 2685 consensus_queue.cc:1059] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20251215 20:52:39.125643 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.112910 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.071913 2728 consensus_queue.cc:1059] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20251215 20:52:39.102411 2627 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:39.105862 2642 raft_consensus.cc:3060] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.101333 2720 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:39.133005 2638 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:39.142717 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.113898 2729 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.114116 2718 raft_consensus.cc:740] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.105960 2258 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:39.145718 2708 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.154752 2638 raft_consensus.cc:3055] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.156893 2638 raft_consensus.cc:740] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.159173 2638 consensus_queue.cc:260] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.160319 2638 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.162465 2716 consensus_queue.cc:1048] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20251215 20:52:39.166347 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:39.141619 1790 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:39.167055 1721 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:39.150178 2684 raft_consensus.cc:3055] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.138525 2724 consensus_queue.cc:1059] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20251215 20:52:39.142863 2720 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.140187 2631 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.192272 1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 711) took 1620 ms. Trace:
I20251215 20:52:39.164477 1786 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:39.143507 2730 consensus_queue.cc:1059] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20251215 20:52:39.192754 1646 rpcz_store.cc:276] 1215 20:52:37.572110 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:37.572247 (+ 137us) service_pool.cc:225] Handling call
1215 20:52:38.452003 (+879756us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:38.455829 (+ 3826us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:39.192033 (+736204us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400326250. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfa52d 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:39.192213 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2022363008}
I20251215 20:52:39.170667 2691 raft_consensus.cc:2749] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.175958 2728 raft_consensus.cc:3055] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:39.206908 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 166962us
I20251215 20:52:39.152082 2717 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.156891 2718 consensus_queue.cc:260] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:39.177836 2721 raft_consensus.cc:3055] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.171212 2684 raft_consensus.cc:740] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:39.172552 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:39.183133 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 89012.1us
I20251215 20:52:39.224958 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:39.208338 1761 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:39.229347 1761 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:39.227394 1717 raft_consensus.cc:2376] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2. Re-sending same reply.
I20251215 20:52:39.206918 2728 raft_consensus.cc:740] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.223349 2721 raft_consensus.cc:740] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.234334 2258 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:39.235376 2638 raft_consensus.cc:3055] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.229190 1787 raft_consensus.cc:2393] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.226372 2724 raft_consensus.cc:3055] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:39.248740 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 365566us
I20251215 20:52:39.236701 2684 consensus_queue.cc:260] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.251207 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.251857 1788 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:39.253307 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.245134 2638 raft_consensus.cc:740] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.242375 2718 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.240967 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.242493 2647 raft_consensus.cc:3055] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:39.252540 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 166817us
I20251215 20:52:39.248100 2724 raft_consensus.cc:740] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.261004 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.247993 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.264554 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.251029 2691 raft_consensus.cc:2749] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.266553 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.267314 1789 raft_consensus.cc:2393] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.268079 1788 raft_consensus.cc:2393] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.276347 2729 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:39.278622 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:39.279474 2712 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.279973 1805 tablet_copy_service.cc:342] P 95847161b0414d4e92d6cab94956fa57: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-f8b4250dab5b409685b9c36ce1898c9b received from {username='slave'} at 127.0.0.1:38896
I20251215 20:52:39.280432 1805 tablet_copy_service.cc:434] P 95847161b0414d4e92d6cab94956fa57: ending tablet copy session fbfdeb011a604f78a77f04be26573717-f8b4250dab5b409685b9c36ce1898c9b on tablet f8b4250dab5b409685b9c36ce1898c9b with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:39.261554 2623 raft_consensus.cc:3055] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.281656 1791 raft_consensus.cc:2393] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.259371 2647 raft_consensus.cc:740] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.250000 2656 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.284255 2623 raft_consensus.cc:740] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:39.296573 2728 consensus_queue.cc:260] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.299572 2728 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.299172 2623 consensus_queue.cc:260] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:39.292825 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.293442 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:39.295441 2681 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:39.286645 1793 raft_consensus.cc:2393] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.300084 1721 raft_consensus.cc:1240] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:39.292493 1794 raft_consensus.cc:2393] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.289127 2684 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.321116 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.322393 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.323503 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.326021 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.329207 2724 consensus_queue.cc:260] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.330421 2724 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.260603 2679 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.312857 2647 consensus_queue.cc:260] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:39.313584 2656 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:39.284497 2638 consensus_queue.cc:260] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.289410 2258 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:39.317068 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.337605 1789 raft_consensus.cc:2393] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.316752 1712 raft_consensus.cc:2468] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:39.316654 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.341266 1788 raft_consensus.cc:2393] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.341332 1720 raft_consensus.cc:1275] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20251215 20:52:39.309237 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:39.297582 2708 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:39.311159 2631 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:39.347708 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.348616 1789 raft_consensus.cc:2393] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.281522 2712 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:39.341378 1716 raft_consensus.cc:1240] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:39.340637 2638 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.349936 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.351394 1788 raft_consensus.cc:2393] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.341641 2623 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.358835 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:39.359498 1713 raft_consensus.cc:2376] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2. Re-sending same reply.
I20251215 20:52:39.348567 2647 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.354350 2708 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:39.347914 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.366873 2730 consensus_queue.cc:1059] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251215 20:52:39.375428 2670 consensus_meta.cc:287] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.937s user 0.008s sys 0.004s
I20251215 20:52:39.376014 2730 raft_consensus.cc:3055] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.367069 2705 consensus_queue.cc:1059] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:39.367655 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.354195 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.382927 1794 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.375891 2670 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.361871 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.373739 1795 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:39.350566 2717 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:39.385671 1789 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:39.350100 2691 raft_consensus.cc:2804] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:39.380239 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.381465 1793 raft_consensus.cc:2376] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3. Re-sending same reply.
I20251215 20:52:39.382026 2679 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:39.353212 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 84211.3us
I20251215 20:52:39.383947 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:39.351109 2631 raft_consensus.cc:2749] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.402413 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.403209 1789 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:39.372001 2609 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.376413 2730 raft_consensus.cc:740] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.376554 2708 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:39.291201 2721 consensus_queue.cc:260] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.390625 1788 raft_consensus.cc:2393] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
W20251215 20:52:39.390537 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 264653us
I20251215 20:52:39.387737 2691 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:39.422813 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:39.424204 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 194908us
I20251215 20:52:39.429224 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.429596 1761 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:39.430269 1719 raft_consensus.cc:1240] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:39.373500 2642 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:39.432096 1789 raft_consensus.cc:2393] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:39.433048 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.433887 1715 raft_consensus.cc:1240] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:39.432489 1761 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:39.449265 1758 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:39.450554 1758 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:39.450094 1788 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:39.416446 2708 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.454634 1758 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:39.461282 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.461651 2670 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:39.430609 2691 raft_consensus.cc:3060] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.499678 1789 raft_consensus.cc:3055] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.501422 1789 raft_consensus.cc:740] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.466111 1761 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:39.484484 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:39.503639 1789 consensus_queue.cc:260] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:39.538801 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 72742.6us
I20251215 20:52:39.540223 1761 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:39.435950 2722 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:39.449788 2729 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:39.388917 2694 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:39.435231 2258 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:39.605216 1789 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.493750 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:39.460319 2681 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:39.463008 2626 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:39.454070 2610 consensus_queue.cc:1059] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.189s
W20251215 20:52:39.684195 1758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 229595us
I20251215 20:52:39.685596 1718 raft_consensus.cc:1240] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:39.491571 2735 raft_consensus.cc:2749] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.605208 2717 raft_consensus.cc:2804] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:39.454246 2631 consensus_queue.cc:1059] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.190s
I20251215 20:52:39.625144 2712 raft_consensus.cc:2749] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:39.706760 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:39.657866 1786 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:39.679973 2729 raft_consensus.cc:2749] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:39.723459 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:39.724781 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:39.504845 2674 consensus_queue.cc:1059] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.171s
I20251215 20:52:39.709915 1715 raft_consensus.cc:1240] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:39.635859 2743 raft_consensus.cc:2749] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.489063 2730 consensus_queue.cc:260] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.684132 2657 raft_consensus.cc:2804] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251215 20:52:39.728799 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 83245.7us
W20251215 20:52:39.687651 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 421457us
I20251215 20:52:39.697415 2717 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:39.736276 2730 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.736801 2733 raft_consensus.cc:2749] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:39.738013 2739 log.cc:927] Time spent T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.094s user 0.000s sys 0.000s
I20251215 20:52:39.733856 2657 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:52:39.702351 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 284278us
I20251215 20:52:39.686757 2626 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.729478 2315 raft_consensus.cc:1240] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:39.628926 2638 raft_consensus.cc:2749] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:39.752604 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:39.801903 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:39.802269 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:39.802747 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:39.748281 1789 raft_consensus.cc:1275] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:39.805080 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:39.742444 2725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s user 0.042s sys 0.049s
I20251215 20:52:39.742762 2612 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
W20251215 20:52:39.775466 2718 consensus_meta.cc:287] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.516s user 0.006s sys 0.000s
I20251215 20:52:39.742915 2717 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.742211 2609 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:39.779587 2694 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:39.781083 2720 consensus_meta.cc:287] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.590s user 0.004s sys 0.007s
I20251215 20:52:39.788491 2642 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:39.673472 2722 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:39.805397 1788 raft_consensus.cc:1275] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 20:52:39.818645 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 278442us
W20251215 20:52:39.806988 2725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s user 0.042s sys 0.050s
I20251215 20:52:39.811892 1792 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:39.819512 1761 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:39.814754 1795 raft_consensus.cc:3055] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.820430 1795 raft_consensus.cc:740] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:39.764827 2657 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.816895 1720 raft_consensus.cc:1275] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 20:52:39.824573 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:39.800427 2742 raft_consensus.cc:3055] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:39.826846 1795 consensus_queue.cc:260] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:39.841611 1795 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:39.847146 2626 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:39.804029 2743 consensus_queue.cc:1059] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20251215 20:52:39.836934 2751 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:39.836876 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:39.878006 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:39.839478 2742 raft_consensus.cc:740] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:39.819053 2733 consensus_queue.cc:1059] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20251215 20:52:39.883019 2724 consensus_meta.cc:287] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.552s user 0.008s sys 0.001s
I20251215 20:52:39.883986 2613 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:39.886132 2728 consensus_queue.cc:1059] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20251215 20:52:39.853335 1761 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:39.825973 2720 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:39.894686 2623 consensus_meta.cc:287] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.533s user 0.006s sys 0.003s
I20251215 20:52:39.888931 1787 raft_consensus.cc:1275] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:39.948451 1791 raft_consensus.cc:1275] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 20:52:39.949088 2749 log.cc:927] Time spent T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.072s user 0.001s sys 0.000s
W20251215 20:52:39.957317 2684 consensus_meta.cc:287] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.636s user 0.005s sys 0.005s
I20251215 20:52:40.043362 1714 raft_consensus.cc:1240] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:40.044268 2647 consensus_meta.cc:287] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.667s user 0.007s sys 0.001s
I20251215 20:52:40.045962 2691 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:40.047847 2691 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:40.043426 2744 log.cc:927] Time spent T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e: Append to log took a long time: real 0.204s user 0.000s sys 0.001s
I20251215 20:52:40.049331 1790 raft_consensus.cc:2468] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:40.085089 2613 tablet_bootstrap.cc:492] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:39.996873 2258 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:40.096654 2722 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:40.098189 2315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:40.100714 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:40.101297 2753 log.cc:927] Time spent T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.156s user 0.000s sys 0.001s
I20251215 20:52:40.018401 2742 consensus_queue.cc:260] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:40.098531 2758 log.cc:927] Time spent T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.099s user 0.000s sys 0.000s
I20251215 20:52:40.111435 2742 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:40.121752 2613 ts_tablet_manager.cc:1403] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 1.777s user 0.021s sys 0.031s
W20251215 20:52:40.113602 2755 log.cc:927] Time spent T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
I20251215 20:52:40.115132 2720 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:40.116644 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 168999us
W20251215 20:52:40.171006 2708 consensus_meta.cc:287] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.682s user 0.008s sys 0.001s
I20251215 20:52:40.171625 2708 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:40.179742 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:40.188624 2756 raft_consensus.cc:2804] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:40.189792 2642 consensus_queue.cc:1048] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:40.191252 2642 consensus_queue.cc:1048] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20251215 20:52:40.193022 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 65730.2us
W20251215 20:52:40.198843 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:40.230249 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:40.248138 2690 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:40.231608 2712 raft_consensus.cc:2764] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20251215 20:52:40.248461 2738 consensus_queue.cc:1059] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:40.248741 2690 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:40.240672 2756 raft_consensus.cc:697] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:40.241994 2710 raft_consensus.cc:3055] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:40.243394 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:40.232257 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 378956us
I20251215 20:52:40.249598 2710 raft_consensus.cc:740] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:40.249979 2756 consensus_queue.cc:237] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:40.250594 2690 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:40.250391 2710 consensus_queue.cc:260] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:40.251364 2710 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:40.252462 2743 consensus_queue.cc:1048] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:40.254428 1543 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47186 (request call id 69) took 1932 ms. Trace:
I20251215 20:52:40.248225 2684 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:40.255678 2684 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:40.257683 2684 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:40.258252 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:40.259727 1761 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:40.260987 2712 raft_consensus.cc:2804] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:40.261358 2712 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:40.261664 2613 raft_consensus.cc:359] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:40.262593 2613 raft_consensus.cc:740] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:40.261687 2712 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:40.263317 2613 consensus_queue.cc:260] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:40.264843 2315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:40.265551 2760 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:40.266251 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:40.234367 1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.102s user 0.009s sys 0.037s
W20251215 20:52:40.266851 1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.134s user 0.010s sys 0.037s
I20251215 20:52:40.249013 2722 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
W20251215 20:52:40.275177 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:40.275602 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:40.281301 1761 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:40.239584 2717 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:40.287663 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:40.288012 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:40.290570 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:40.292647 2674 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:40.289122 1761 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:40.290024 2724 consensus_queue.cc:1059] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:40.293195 2674 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:40.294293 2724 raft_consensus.cc:2749] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:40.295496 2674 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:40.295517 1761 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:40.266036 2760 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:40.266291 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:40.302729 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:40.311527 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:40.303339 1646 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:40.320722 1721 raft_consensus.cc:3060] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:40.311069 2729 raft_consensus.cc:2749] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:40.325829 2730 raft_consensus.cc:3055] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:40.326344 2730 raft_consensus.cc:740] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:40.326658 1788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 643) took 1155 ms. Trace:
I20251215 20:52:40.327039 1788 rpcz_store.cc:276] 1215 20:52:39.171028 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.574888 (+403860us) service_pool.cc:225] Handling call
1215 20:52:39.801966 (+227078us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:39.818783 (+ 16817us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:40.326447 (+507664us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001702d0. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfa52d 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:40.326573 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":332334976}
I20251215 20:52:40.327194 2730 consensus_queue.cc:260] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:40.328121 1721 raft_consensus.cc:2468] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
W20251215 20:52:40.328634 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:40.295986 2717 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:40.309095 1761 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:40.276518 2733 consensus_queue.cc:1059] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20251215 20:52:40.297850 2743 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:40.288594 2722 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:40.348575 1686 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:40.352730 1761 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:40.303634 2612 tablet_bootstrap.cc:700] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Time spent opening tablet: real 0.164s user 0.002s sys 0.000s
I20251215 20:52:40.254769 1543 rpcz_store.cc:276] 1215 20:52:38.322058 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:38.322193 (+ 135us) service_pool.cc:225] Handling call
1215 20:52:40.254367 (+1932174us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:38.922332 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:38.970967 (+ 48635us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:38.978367 (+ 7400us) write_op.cc:435] Acquired schema lock
1215 20:52:39.004527 (+ 26160us) tablet.cc:660] Decoding operations
1215 20:52:39.039851 (+ 35324us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:39.043632 (+ 3781us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:39.045707 (+ 2075us) tablet.cc:683] Acquiring locks for 1 operations
1215 20:52:39.067786 (+ 22079us) tablet.cc:699] Row locks acquired
1215 20:52:39.067819 (+ 33us) write_op.cc:260] PREPARE: finished
1215 20:52:39.087670 (+ 19851us) write_op.cc:270] Start()
1215 20:52:39.092962 (+ 5292us) write_op.cc:276] Timestamp: P: 1765831959085620 usec, L: 0
1215 20:52:39.095557 (+ 2595us) op_driver.cc:348] REPLICATION: starting
1215 20:52:39.182241 (+ 86684us) log.cc:844] Serialized 535 byte log entry
1215 20:52:40.234195 (+1051954us) op_driver.cc:464] REPLICATION: finished
1215 20:52:40.245193 (+ 10998us) write_op.cc:301] APPLY: starting
1215 20:52:40.245273 (+ 80us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:40.245368 (+ 95us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:40.245513 (+ 145us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:40.245738 (+ 225us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:40.245890 (+ 152us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1215 20:52:40.245934 (+ 44us) write_op.cc:312] APPLY: finished
1215 20:52:40.246246 (+ 312us) log.cc:844] Serialized 22 byte log entry
1215 20:52:40.246906 (+ 660us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:40.246999 (+ 93us) write_op.cc:454] Released schema lock
1215 20:52:40.247034 (+ 35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":10759,"apply.run_cpu_time_us":1622,"apply.run_wall_time_us":31572,"num_ops":1,"prepare.queue_time_us":42348,"prepare.run_cpu_time_us":97156,"prepare.run_wall_time_us":920623,"raft.queue_time_us":184609,"raft.run_cpu_time_us":9570,"raft.run_wall_time_us":10998,"replication_time_us":1134785,"thread_start_us":828449,"threads_started":4,"wal-append.queue_time_us":621740}]]}
W20251215 20:52:40.344220 1643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s user 0.025s sys 0.035s
I20251215 20:52:40.359316 2730 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:40.350486 2747 log.cc:927] Time spent T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.645s user 0.002s sys 0.011s
I20251215 20:52:40.282066 2657 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:40.347623 2721 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:40.368127 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.368744 1788 raft_consensus.cc:1240] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:40.369087 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.369597 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.377800 1795 raft_consensus.cc:2393] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:40.372171 1794 raft_consensus.cc:1240] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:40.372982 1789 raft_consensus.cc:1240] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:40.365197 1643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s user 0.026s sys 0.035s
I20251215 20:52:40.376626 1791 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:40.353304 2728 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:40.378969 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:40.381614 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:40.372395 1786 raft_consensus.cc:1240] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:40.375694 2659 raft_consensus.cc:2749] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:40.353690 2708 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:40.379822 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:40.382805 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.387178 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.379297 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:40.387107 1758 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:40.392642 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:40.391381 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.393383 1795 raft_consensus.cc:2368] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 2. Current term is 3.
I20251215 20:52:40.395462 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:40.395505 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.396205 1646 raft_consensus.cc:2393] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:40.396015 2657 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:40.398007 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:40.398403 2613 ts_tablet_manager.cc:1434] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.276s user 0.021s sys 0.030s
I20251215 20:52:40.398952 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:40.399959 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:40.400847 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:40.401316 1646 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:40.402712 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.403322 1794 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:40.382174 1787 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:40.396981 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:40.396943 1788 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:40.407431 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:40.409373 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:40.411074 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:40.416385 1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 641) took 1404 ms. Trace:
I20251215 20:52:40.416764 1716 rpcz_store.cc:276] 1215 20:52:39.011843 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.110992 (+ 99149us) service_pool.cc:225] Handling call
1215 20:52:39.111364 (+ 372us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:39.349380 (+238016us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:40.416132 (+1066752us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540009bad4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:40.416327 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":528466176}
I20251215 20:52:40.398326 1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59670 (request call id 35) took 1306 ms. Trace:
I20251215 20:52:40.412024 2760 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:40.413913 1646 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:40.414366 2312 raft_consensus.cc:1217] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251215 20:52:40.420815 1643 rpcz_store.cc:276] 1215 20:52:39.091709 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.093481 (+ 1772us) service_pool.cc:225] Handling call
1215 20:52:39.096365 (+ 2884us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:39.388814 (+292449us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:39.388895 (+ 81us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:39.453804 (+ 64909us) log.cc:844] Serialized 26 byte log entry
1215 20:52:40.385566 (+931762us) raft_consensus.cc:1645] Marking committed up to 4
1215 20:52:40.386666 (+ 1100us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:40.390960 (+ 4294us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:40.392639 (+ 1679us) raft_consensus.cc:1685] finished
1215 20:52:40.394437 (+ 1798us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:40.398270 (+ 3833us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1798,"raft.queue_time_us":56922,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8082,"thread_start_us":1195057,"threads_started":2,"wal-append.queue_time_us":377265}
I20251215 20:52:40.415177 1788 raft_consensus.cc:1240] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:40.394546 2757 raft_consensus.cc:2749] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:40.388268 2315 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:40.416137 2258 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:40.505075 2735 raft_consensus.cc:3055] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:40.505509 2735 raft_consensus.cc:740] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:40.506400 2735 consensus_queue.cc:260] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:40.544391 2760 raft_consensus.cc:2804] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:40.545051 2760 raft_consensus.cc:697] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:40.545976 2760 consensus_queue.cc:237] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:40.665555 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:40.717270 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:41.204704 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:41.259079 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:41.799121 2764 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:41.801407 2765 raft_consensus.cc:2804] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:41.915670 2765 raft_consensus.cc:697] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:41.916957 2765 consensus_queue.cc:237] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:41.960987 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:41.962935 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.160895 1612 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.747s user 0.010s sys 0.029s
W20251215 20:52:42.161441 1612 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.748s user 0.010s sys 0.029s
W20251215 20:52:42.161888 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 1.74844e+06us
W20251215 20:52:42.163283 1612 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.522s (SENT)
I20251215 20:52:42.163847 1612 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:42.175639 1667 debug-util.cc:398] Leaking SignalData structure 0x7b08000602e0 after lost signal to thread 429
I20251215 20:52:42.185328 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.194972 1640 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
W20251215 20:52:42.198370 1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 901) took 1919 ms (client timeout 2152 ms). Trace:
W20251215 20:52:42.198985 1640 rpcz_store.cc:269] 1215 20:52:40.278776 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:42.184538 (+1905762us) service_pool.cc:225] Handling call
1215 20:52:42.198235 (+ 13697us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:42.202670 2712 consensus_meta.cc:287] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 1.905s user 0.005s sys 0.018s
I20251215 20:52:42.203195 2712 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.206333 2712 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:42.217198 2730 consensus_meta.cc:287] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 1.851s user 0.009s sys 0.015s
I20251215 20:52:42.227977 1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 897) took 1950 ms. Trace:
I20251215 20:52:42.228503 1642 rpcz_store.cc:276] 1215 20:52:40.277761 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:42.226380 (+1948619us) service_pool.cc:225] Handling call
1215 20:52:42.227066 (+ 686us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:42.227479 (+ 413us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:42.227514 (+ 35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:42.227562 (+ 48us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:42.227581 (+ 19us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.227662 (+ 81us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:42.227806 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:42.241843 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.242395 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.242254 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 79040.7us
I20251215 20:52:42.244073 2737 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.244443 2775 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:42.244768 2737 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.247475 2737 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.250252 2775 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:42.251327 2775 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:42.252803 1790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46054 (request call id 621) took 3255 ms (client timeout 1722 ms). Trace:
W20251215 20:52:42.254765 1790 rpcz_store.cc:269] 1215 20:52:38.997557 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.195630 (+198073us) service_pool.cc:225] Handling call
1215 20:52:39.325872 (+130242us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b5800002a98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:42.252267 (+2926395us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b540019f354. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:42.252511 (+ 244us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1675494144}
I20251215 20:52:42.269033 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.270103 1791 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
W20251215 20:52:42.270685 1791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46050 (request call id 863) took 1877 ms (client timeout 2139 ms). Trace:
W20251215 20:52:42.271076 1791 rpcz_store.cc:269] 1215 20:52:40.393112 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:40.394780 (+ 1668us) service_pool.cc:225] Handling call
1215 20:52:42.270558 (+1875778us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:42.272716 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.273161 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.319658 2777 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:42.320760 2777 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.323374 2777 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:42.326889 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.326735 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.333628 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.334192 1640 raft_consensus.cc:3060] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.334908 1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 899) took 2056 ms. Trace:
I20251215 20:52:42.335323 1641 rpcz_store.cc:276] 1215 20:52:40.278297 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:42.333532 (+2055235us) service_pool.cc:225] Handling call
1215 20:52:42.334040 (+ 508us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:42.334427 (+ 387us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:42.334456 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:42.334517 (+ 61us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:42.334550 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.334616 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:42.334751 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:42.333804 1642 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:42.334852 1646 raft_consensus.cc:2393] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:42.336589 2737 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.337826 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.338011 2737 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.338778 1638 raft_consensus.cc:3060] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.344982 2737 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.258172 2775 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:42.346099 1640 raft_consensus.cc:2468] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:42.347795 1642 raft_consensus.cc:1240] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.350710 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.351094 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.353808 1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 642) took 3341 ms. Trace:
I20251215 20:52:42.353997 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.354485 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.354945 1646 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.356040 1642 raft_consensus.cc:2393] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:42.354445 1714 rpcz_store.cc:276] 1215 20:52:39.012093 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.123290 (+111197us) service_pool.cc:225] Handling call
1215 20:52:39.123603 (+ 313us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:40.043868 (+920265us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.353008 (+2309140us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54000eae54. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:42.353439 (+ 431us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2009951488}
W20251215 20:52:42.357714 1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.004s user 0.034s sys 0.052s
W20251215 20:52:42.358107 1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.004s user 0.034s sys 0.052s
I20251215 20:52:42.358438 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.359022 1641 raft_consensus.cc:1240] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.359570 2777 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.358645 1643 raft_consensus.cc:1240] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:42.358637 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 2.00976e+06us
W20251215 20:52:42.362648 1612 leader_election.cc:336] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.550s (SENT)
I20251215 20:52:42.363127 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.364051 1640 raft_consensus.cc:3060] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.362692 1644 raft_consensus.cc:1240] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 3. Current term is 4. Ops: []
W20251215 20:52:42.367410 1612 leader_election.cc:336] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.554s (SENT)
I20251215 20:52:42.367929 1612 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.367815 2772 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:42.368762 1646 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:42.368841 2772 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.372026 2772 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.372754 2772 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.373567 2772 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.375676 1640 raft_consensus.cc:2468] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:42.375757 2772 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.360859 2777 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.378772 2777 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.365098 2737 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.379613 2737 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:42.381910 1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.382031 2690 raft_consensus.cc:2749] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.366565 1638 raft_consensus.cc:2468] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:42.387555 2756 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.388569 2756 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.389127 1644 raft_consensus.cc:1240] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.401419 2763 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:42.402325 2763 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.406419 1643 raft_consensus.cc:1240] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.406697 1642 raft_consensus.cc:1240] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.406991 1641 raft_consensus.cc:1240] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.407948 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.408171 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.408649 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.408857 1642 raft_consensus.cc:2468] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:42.409157 1641 raft_consensus.cc:2393] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:42.410717 2763 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.412940 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.409226 2756 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.415134 2756 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:42.415882 2756 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.419327 1640 raft_consensus.cc:1240] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3. Ops: []
W20251215 20:52:42.452956 1792 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46054 (request call id 638) took 3315 ms (client timeout 1514 ms). Trace:
I20251215 20:52:42.419385 1656 tablet_copy_service.cc:342] P 9b3367a5854f49b98da54556a209b0de: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-cd752a241baf44c3aa4fda90213e209f received from {username='slave'} at 127.0.0.1:59670
I20251215 20:52:42.418084 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.454152 1656 tablet_copy_service.cc:434] P 9b3367a5854f49b98da54556a209b0de: ending tablet copy session fbfdeb011a604f78a77f04be26573717-cd752a241baf44c3aa4fda90213e209f on tablet cd752a241baf44c3aa4fda90213e209f with peer fbfdeb011a604f78a77f04be26573717
W20251215 20:52:42.429991 1686 connection.cc:232] RPC call timeout handler was delayed by -1.6788120519999836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20251215 20:52:42.455780 1686 connection.cc:232] RPC call timeout handler was delayed by -1.5468067310000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20251215 20:52:42.426379 2772 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.457131 1644 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:42.457986 2780 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.458662 2780 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.449278 2737 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:42.461970 2256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.577s user 0.000s sys 0.011s
I20251215 20:52:42.462199 2780 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.457122 2772 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.467813 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 639) took 3456 ms. Trace:
I20251215 20:52:42.468183 2772 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.468276 1718 rpcz_store.cc:276] 1215 20:52:39.011384 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.051649 (+ 40265us) service_pool.cc:225] Handling call
1215 20:52:39.051913 (+ 264us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:39.686072 (+634159us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.467297 (+2781225us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54002094d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:42.467621 (+ 324us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1456708480}
I20251215 20:52:42.469828 2783 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.476272 2783 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.477041 1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 902) took 2197 ms. Trace:
I20251215 20:52:42.477464 1645 rpcz_store.cc:276] 1215 20:52:40.279025 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:42.475843 (+2196818us) service_pool.cc:225] Handling call
1215 20:52:42.476324 (+ 481us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:42.476596 (+ 272us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:42.476619 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:42.476683 (+ 64us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:42.476714 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.476765 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:42.476880 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:42.471167 2772 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.479328 2772 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.472630 2312 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
W20251215 20:52:42.473702 2256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.589s user 0.001s sys 0.012s
I20251215 20:52:42.482016 2772 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:42.482599 2772 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.418170 2756 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:42.453500 1792 rpcz_store.cc:269] 1215 20:52:39.137888 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.152491 (+ 14603us) service_pool.cc:225] Handling call
1215 20:52:42.452496 (+3300005us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54003043d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:42.452716 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1351877376}
I20251215 20:52:42.484359 2756 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.484422 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:42.485596 2756 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:42.473071 1612 connection.cc:232] RPC call timeout handler was delayed by -1.8535269570000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20251215 20:52:42.487663 1612 connection.cc:232] RPC call timeout handler was delayed by -1.8355269570000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20251215 20:52:42.487970 1612 connection.cc:232] RPC call timeout handler was delayed by -1.8333235199999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2861s for a response
I20251215 20:52:42.426746 1646 raft_consensus.cc:1240] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:42.488574 1612 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.514s (SENT)
W20251215 20:52:42.500828 1612 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.562s (SENT)
W20251215 20:52:42.502190 1612 connection.cc:232] RPC call timeout handler was delayed by -1.8146546070000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20251215 20:52:42.502750 1612 leader_election.cc:336] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.581s (SENT)
W20251215 20:52:42.504061 1612 leader_election.cc:336] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.583s (SENT)
I20251215 20:52:42.504336 2756 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:42.505200 1612 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.614s (SENT)
I20251215 20:52:42.505693 1612 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.506556 2737 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:42.508157 1612 leader_election.cc:336] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.627s (SENT)
I20251215 20:52:42.508647 1612 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:42.509608 1667 debug-util.cc:398] Leaking SignalData structure 0x7b080019eaa0 after lost signal to thread 1578
I20251215 20:52:42.513025 2783 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.513964 2737 raft_consensus.cc:2749] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:42.515712 1612 leader_election.cc:336] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.660s (SENT)
W20251215 20:52:42.516906 2721 consensus_meta.cc:287] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 2.139s user 0.011s sys 0.006s
W20251215 20:52:42.517382 1612 leader_election.cc:336] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.670s (SENT)
I20251215 20:52:42.518137 1793 raft_consensus.cc:1275] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 20:52:42.518677 1612 leader_election.cc:336] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.722s (SENT)
W20251215 20:52:42.519918 1612 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.769s (SENT)
I20251215 20:52:42.520457 1793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 644) took 3340 ms. Trace:
W20251215 20:52:42.520896 1612 connection.cc:232] RPC call timeout handler was delayed by -1.7923104770000293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30970000000000003s for a response
W20251215 20:52:42.521515 1612 leader_election.cc:336] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.811s (SENT)
I20251215 20:52:42.521889 1612 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.522647 2737 raft_consensus.cc:2749] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:42.524070 1612 leader_election.cc:336] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.817s (SENT)
I20251215 20:52:42.520937 1793 rpcz_store.cc:276] 1215 20:52:39.179685 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.700122 (+520437us) service_pool.cc:225] Handling call
1215 20:52:39.792358 (+ 92236us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:42.518633 (+2726275us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.519989 (+ 1356us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b540021a554. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:42.520278 (+ 289us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6266449792}
I20251215 20:52:42.483340 2772 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:42.529603 1612 leader_election.cc:336] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.842s (SENT)
I20251215 20:52:42.530290 1612 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:42.531374 1712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.149s user 0.011s sys 0.011s
W20251215 20:52:42.531924 1712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.153s user 0.012s sys 0.012s
W20251215 20:52:42.532017 1612 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.859s (SENT)
I20251215 20:52:42.533084 1612 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.534082 2690 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:42.534704 1612 leader_election.cc:336] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.874s (SENT)
W20251215 20:52:42.536247 1612 leader_election.cc:336] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.954s (SENT)
I20251215 20:52:42.536856 1612 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.537885 2690 raft_consensus.cc:2749] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:42.538408 1612 leader_election.cc:336] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.022s (SENT)
W20251215 20:52:42.539971 1612 leader_election.cc:336] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.089s (SENT)
I20251215 20:52:42.530210 2772 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:42.541098 1686 connection.cc:232] RPC call timeout handler was delayed by -1.1701530609999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20251215 20:52:42.534206 2737 raft_consensus.cc:2749] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.538416 1637 raft_consensus.cc:1240] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:42.541742 1686 connection.cc:232] RPC call timeout handler was delayed by -1.1185890760000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20251215 20:52:42.542205 1686 connection.cc:232] RPC call timeout handler was delayed by -1.0516313259999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
I20251215 20:52:42.543545 1637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 898) took 2265 ms. Trace:
I20251215 20:52:42.536178 2257 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:42.544668 1637 rpcz_store.cc:276] 1215 20:52:40.278050 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:42.537626 (+2259576us) service_pool.cc:225] Handling call
1215 20:52:42.538095 (+ 469us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:42.542604 (+ 4509us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.543473 (+ 869us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:42.546341 2756 raft_consensus.cc:2804] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:42.546217 2257 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.546792 2756 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:42.547102 2756 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:42.547446 2782 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20251215 20:52:42.543715 1612 leader_election.cc:336] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.162s (SENT)
W20251215 20:52:42.544625 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.554922 2647 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.555760 2647 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.557859 2647 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.562516 2722 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.564914 2721 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.565670 2721 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:42.566423 1687 connection.cc:232] RPC call timeout handler was delayed by -2.0810304199999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20251215 20:52:42.567883 2721 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.569564 2752 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.570264 2752 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.573022 2750 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.573168 2724 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:42.573853 2724 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.573822 2750 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.576822 2712 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:42.577360 2730 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.577566 2712 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.577996 2730 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.576145 2724 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.579608 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.579761 2712 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.580163 2730 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.580813 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.576498 2750 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.585052 1686 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:42.565274 1612 leader_election.cc:336] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.171s (SENT)
I20251215 20:52:42.585932 1788 raft_consensus.cc:1240] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:42.586573 2718 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.063s user 0.006s sys 0.009s
I20251215 20:52:42.586758 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.587406 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.588014 1795 raft_consensus.cc:1240] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.588274 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.563993 2756 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.568945 2647 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.591241 1612 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.593818 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.594247 1792 raft_consensus.cc:2393] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:42.593700 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.596105 2722 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:42.596386 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.572611 2752 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.579622 2724 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.588471 2712 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.605696 1786 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.605468 2724 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:42.606623 1612 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.188s (SENT)
W20251215 20:52:42.607798 1612 leader_election.cc:336] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.201s (SENT)
I20251215 20:52:42.608103 2724 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.605621 2712 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.608151 1612 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.609370 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.609586 2690 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.610169 1790 raft_consensus.cc:2393] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:42.610283 2690 raft_consensus.cc:2749] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.610364 2712 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.610690 2772 raft_consensus.cc:2749] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.611222 2722 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:42.603302 1687 connection.cc:232] RPC call timeout handler was delayed by -1.8697685319999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20251215 20:52:42.612653 1612 connection.cc:232] RPC call timeout handler was delayed by -1.7392269569999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20251215 20:52:42.613111 1687 connection.cc:232] RPC call timeout handler was delayed by -1.8476974190000135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20251215 20:52:42.613346 2772 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.613664 2722 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:42.613991 1687 connection.cc:232] RPC call timeout handler was delayed by -1.7499463959999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20251215 20:52:42.614370 1687 connection.cc:232] RPC call timeout handler was delayed by -1.6490304200000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20251215 20:52:42.614864 1687 connection.cc:232] RPC call timeout handler was delayed by -1.5298660889999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20251215 20:52:42.615319 2783 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.615010 2772 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.615506 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:42.616408 2320 raft_consensus.cc:2393] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:42.615993 2783 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.616684 2784 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.617435 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.617560 2784 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.618453 2783 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:42.619362 1687 connection.cc:232] RPC call timeout handler was delayed by -1.3813253969999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20251215 20:52:42.619807 1687 connection.cc:232] RPC call timeout handler was delayed by -1.3692487799999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20251215 20:52:42.608371 1787 raft_consensus.cc:2393] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
W20251215 20:52:42.620440 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.621097 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.610780 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.621212 1791 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.622285 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:42.620146 1687 connection.cc:232] RPC call timeout handler was delayed by -1.3599930430000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20251215 20:52:42.622874 2612 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 2.248s user 0.005s sys 0.022s
W20251215 20:52:42.622989 1687 connection.cc:232] RPC call timeout handler was delayed by -1.3200602379999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20251215 20:52:42.623314 2612 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 2.248s user 0.005s sys 0.022s
I20251215 20:52:42.625535 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:42.623553 1687 connection.cc:232] RPC call timeout handler was delayed by -1.3140930430000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20251215 20:52:42.620088 2784 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:42.627722 1687 connection.cc:232] RPC call timeout handler was delayed by -1.3060253079999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20251215 20:52:42.630237 1687 connection.cc:232] RPC call timeout handler was delayed by -1.2668936919999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20251215 20:52:42.630883 1687 connection.cc:232] RPC call timeout handler was delayed by -1.2549133390000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20251215 20:52:42.579766 2721 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:42.631179 1687 connection.cc:232] RPC call timeout handler was delayed by -1.1645567580000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20251215 20:52:42.634788 1687 connection.cc:232] RPC call timeout handler was delayed by -1.082506555000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
I20251215 20:52:42.590358 2730 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
W20251215 20:52:42.635208 1687 connection.cc:232] RPC call timeout handler was delayed by -1.0679921980000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20251215 20:52:42.634406 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:42.613129 1612 connection.cc:232] RPC call timeout handler was delayed by -1.6364546070000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20251215 20:52:42.633384 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.633778 2670 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:42.597319 2718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.074s user 0.006s sys 0.010s
I20251215 20:52:42.636184 1793 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
W20251215 20:52:42.637796 1612 connection.cc:232] RPC call timeout handler was delayed by -1.6121546070000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20251215 20:52:42.638228 1612 connection.cc:232] RPC call timeout handler was delayed by -1.5752546070000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20251215 20:52:42.639094 1612 connection.cc:232] RPC call timeout handler was delayed by -1.5707546070000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20251215 20:52:42.639355 1612 connection.cc:232] RPC call timeout handler was delayed by -1.5239546070000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20251215 20:52:42.640470 1612 connection.cc:232] RPC call timeout handler was delayed by -1.5232834950000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20251215 20:52:42.640962 1612 connection.cc:232] RPC call timeout handler was delayed by -1.5151834950000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
I20251215 20:52:42.631809 2772 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:42.641223 1612 connection.cc:232] RPC call timeout handler was delayed by -1.3900269570000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20251215 20:52:42.644079 1612 connection.cc:232] RPC call timeout handler was delayed by -1.3642390440000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20251215 20:52:42.644335 1612 connection.cc:232] RPC call timeout handler was delayed by -1.276095975000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3173s for a response
I20251215 20:52:42.642076 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.635062 2647 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.651744 1787 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.642455 2730 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.641342 2670 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:42.657802 2626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.295s user 0.031s sys 0.031s
W20251215 20:52:42.658239 2626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.299s user 0.031s sys 0.031s
I20251215 20:52:42.658680 2730 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:42.651657 1790 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.663616 1786 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.643081 2778 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:42.664805 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.665275 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.642966 2721 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:42.665570 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.666632 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.667127 2721 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.658252 2670 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.668563 2752 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.669128 2752 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.671186 2752 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.668092 2724 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.677951 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:42.678700 2785 log.cc:927] Time spent T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.073s user 0.001s sys 0.000s
I20251215 20:52:42.677757 2724 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.679454 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:42.680644 2320 raft_consensus.cc:1240] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.681372 2724 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.681711 2612 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:42.682283 1792 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.667338 2750 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.681372 1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38116 (request call id 41) took 2411 ms. Trace:
I20251215 20:52:42.684944 1712 rpcz_store.cc:276] 1215 20:52:40.269900 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:40.272736 (+ 2836us) service_pool.cc:225] Handling call
1215 20:52:40.351733 (+ 78997us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:42.532557 (+2180824us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:42.532605 (+ 48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:42.533277 (+ 672us) log.cc:844] Serialized 26 byte log entry
1215 20:52:42.553458 (+ 20181us) raft_consensus.cc:1645] Marking committed up to 4
1215 20:52:42.554432 (+ 974us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.564492 (+ 10060us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:42.681142 (+116650us) raft_consensus.cc:1685] finished
1215 20:52:42.681162 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:42.681313 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1458781,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"thread_start_us":2172831,"threads_started":2,"wal-append.queue_time_us":32252}
I20251215 20:52:42.688941 1718 raft_consensus.cc:1240] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.690469 2752 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.691135 2752 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.691653 2647 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.692236 2647 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:42.692409 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.693176 1646 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:42.693748 2724 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:42.694096 2737 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:42.694180 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.694902 1645 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:42.695813 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.696002 1721 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:42.696877 2737 consensus_queue.cc:237] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.697721 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.691920 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.698773 1712 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:42.692947 2775 consensus_queue.cc:1059] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20251215 20:52:42.700858 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.701167 2756 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.701757 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.702507 2659 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.704108 1717 raft_consensus.cc:1240] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:42.704610 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:42.705053 2728 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.706295 2612 tablet_bootstrap.cc:492] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:42.706638 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.707429 2612 ts_tablet_manager.cc:1403] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 2.983s user 0.018s sys 0.035s
I20251215 20:52:42.693353 2752 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:42.704380 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 47816.1us
W20251215 20:52:42.701968 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.708175 1686 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:42.692876 2647 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.703161 2659 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:42.705768 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.719758 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.721856 1788 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.700125 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:42.725787 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.727664 2765 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:42.728062 2743 raft_consensus.cc:3055] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:42.728241 2765 raft_consensus.cc:697] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:42.728487 2743 raft_consensus.cc:740] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:42.729283 2659 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.705680 2728 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.730224 2622 raft_consensus.cc:3055] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:42.730683 2622 raft_consensus.cc:740] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:42.731448 2728 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:42.664808 2778 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.734211 2778 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:42.729642 2765 consensus_queue.cc:237] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
W20251215 20:52:42.734354 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.736202 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.738255 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:42.739677 2724 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.741742 2724 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:42.742381 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.743633 1791 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
W20251215 20:52:42.744398 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:42.731716 2622 consensus_queue.cc:260] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.745806 2622 raft_consensus.cc:3060] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.747340 1790 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.727005 2750 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:42.749523 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.751183 2750 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:42.726467 1792 raft_consensus.cc:2393] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:42.748833 1794 raft_consensus.cc:2468] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
W20251215 20:52:42.759910 2315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 95) took 2495 ms (client timeout 2122 ms). Trace:
I20251215 20:52:42.760622 1787 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.729673 2743 consensus_queue.cc:260] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:42.773900 2315 rpcz_store.cc:269] 1215 20:52:40.264408 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:40.264567 (+ 159us) service_pool.cc:225] Handling call
1215 20:52:42.759533 (+2494966us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400540e54. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:42.759711 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":273786752}
I20251215 20:52:42.774839 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:42.778827 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:42.779112 1667 debug-util.cc:398] Leaking SignalData structure 0x7b0800394d20 after lost signal to thread 1670
I20251215 20:52:42.760807 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.783180 1637 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:42.787024 2612 raft_consensus.cc:359] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:42.788923 2636 raft_consensus.cc:3055] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:42.789403 2636 raft_consensus.cc:740] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:42.762099 2647 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:42.790313 2636 consensus_queue.cc:260] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.791512 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.790730 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.791829 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.791662 2636 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:42.792747 1718 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.794034 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.752053 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.796545 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.796717 1712 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.797406 1717 raft_consensus.cc:1275] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:42.773748 1686 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:42.798705 2720 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:42.798853 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.799289 2720 raft_consensus.cc:697] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
W20251215 20:52:42.799355 1760 connection.cc:232] RPC call timeout handler was delayed by -1.58416115899999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20251215 20:52:42.799815 1760 connection.cc:232] RPC call timeout handler was delayed by -1.5193611589999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20251215 20:52:42.800277 2720 consensus_queue.cc:237] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.801836 2750 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:42.802454 2750 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:42.800138 1760 connection.cc:232] RPC call timeout handler was delayed by -1.4527611589999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20251215 20:52:42.804803 1760 connection.cc:232] RPC call timeout handler was delayed by -1.3249611589999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20251215 20:52:42.805159 1760 connection.cc:232] RPC call timeout handler was delayed by -1.2448611589999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20251215 20:52:42.805459 1760 connection.cc:232] RPC call timeout handler was delayed by -1.1197332710000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20251215 20:52:42.805763 1760 connection.cc:232] RPC call timeout handler was delayed by -1.0612611589999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20251215 20:52:42.806072 1760 connection.cc:232] RPC call timeout handler was delayed by -1.0540611589999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20251215 20:52:42.806373 1760 connection.cc:232] RPC call timeout handler was delayed by -1.0360611589999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20251215 20:52:42.806674 1760 connection.cc:232] RPC call timeout handler was delayed by -1.0087581059999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20251215 20:52:42.806954 1760 connection.cc:232] RPC call timeout handler was delayed by -1.0045611589999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
I20251215 20:52:42.808461 2257 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:42.808007 1544 catalog_manager.cc:5654] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:42.810357 2750 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:42.811077 1544 catalog_manager.cc:5654] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:42.815446 2743 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.816664 1544 catalog_manager.cc:5654] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:42.814764 1793 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.819087 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.821658 1793 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.822757 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.825356 1714 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:42.825737 1789 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.827564 2315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:42.831179 1760 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.831902 2763 raft_consensus.cc:2804] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:42.852658 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.850550 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.841998 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:42.836990 2679 consensus_queue.cc:1059] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20251215 20:52:42.842746 1687 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.504s (SENT) [suppressed 84 similar messages]
I20251215 20:52:42.855070 1788 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:42.843320 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.843575 1793 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.848088 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.852794 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:42.842201 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 52567us
I20251215 20:52:42.854667 1641 raft_consensus.cc:2393] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:42.820271 1544 catalog_manager.cc:5654] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:42.843484 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.788165 2612 raft_consensus.cc:740] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:42.859038 2647 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:42.852558 2763 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:42.868083 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.869616 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.870054 1788 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.866181 1544 catalog_manager.cc:5654] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:42.870263 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.870745 1792 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.856619 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.872347 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.871834 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.874142 1640 raft_consensus.cc:2393] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:42.868595 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:42.876446 1687 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.563s (SENT)
I20251215 20:52:42.876562 1646 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:42.877884 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.874538 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.875685 1641 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:42.878851 1720 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:42.871760 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.880062 1687 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:42.880954 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 49897.3us
I20251215 20:52:42.881603 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.882462 1643 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.884367 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:42.885099 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.886047 1786 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:42.886798 1790 raft_consensus.cc:1240] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.877756 2750 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:42.871886 2763 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:42.887642 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.888437 2735 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.868171 2756 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20251215 20:52:42.891037 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.882025 1760 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:42.881753 1687 leader_election.cc:336] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.576s (SENT)
I20251215 20:52:42.890789 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.898236 2638 raft_consensus.cc:3055] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:42.897138 1646 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:42.901238 2638 raft_consensus.cc:740] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:42.896768 1612 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.902556 2777 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:42.902311 2638 consensus_queue.cc:260] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.903108 2777 raft_consensus.cc:697] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:42.903411 2638 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.892702 2750 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:42.904461 2777 consensus_queue.cc:237] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.882651 2647 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:42.905359 2750 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.888972 1790 raft_consensus.cc:1240] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.908641 1612 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:42.908540 1687 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:42.909612 1793 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:42.909752 2784 raft_consensus.cc:2749] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.908232 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.910817 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.899075 1642 raft_consensus.cc:2468] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:42.911769 2258 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.910976 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.912935 2732 raft_consensus.cc:3055] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:42.913341 2732 raft_consensus.cc:740] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:42.914173 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.916898 1794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38896 (request call id 38) took 2486 ms. Trace:
I20251215 20:52:42.917011 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.917346 1794 rpcz_store.cc:276] 1215 20:52:40.430067 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:42.706193 (+2276126us) service_pool.cc:225] Handling call
1215 20:52:42.916752 (+210559us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b540019f354. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:42.916844 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":95454592}
I20251215 20:52:42.918066 1612 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.918253 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.918994 1642 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
W20251215 20:52:42.919284 1684 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:42.919843 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.890504 2679 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.921497 2705 raft_consensus.cc:2804] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:42.922075 2705 raft_consensus.cc:697] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:42.922498 2690 raft_consensus.cc:2749] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.923146 2705 consensus_queue.cc:237] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.918372 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.924072 2718 consensus_queue.cc:1059] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20251215 20:52:42.924698 1667 debug-util.cc:398] Leaking SignalData structure 0x7b080037d320 after lost signal to thread 1745
W20251215 20:52:42.925099 1667 debug-util.cc:398] Leaking SignalData structure 0x7b0800369c40 after lost signal to thread 1746
I20251215 20:52:42.914378 2732 consensus_queue.cc:260] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.925367 2631 raft_consensus.cc:3055] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:42.925812 2631 raft_consensus.cc:740] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:42.926002 2724 consensus_queue.cc:1059] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:42.920821 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.927094 2743 raft_consensus.cc:3055] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:42.927588 1760 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:42.927821 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.926749 2631 consensus_queue.cc:260] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.928424 2724 raft_consensus.cc:2804] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:42.924849 1794 raft_consensus.cc:2393] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:42.923959 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 633) took 3913 ms. Trace:
I20251215 20:52:42.892338 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:42.911067 1687 leader_election.cc:336] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.586s (SENT)
I20251215 20:52:42.923939 1612 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.932600 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.934887 1645 raft_consensus.cc:2468] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:42.935180 1686 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:42.893584 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.937309 1792 raft_consensus.cc:2393] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:42.937103 1687 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:42.928902 2631 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.939827 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.940466 1794 raft_consensus.cc:3060] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.940549 2690 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.927592 2743 raft_consensus.cc:740] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:42.943413 2743 consensus_queue.cc:260] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:42.929454 1719 rpcz_store.cc:276] 1215 20:52:39.009971 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:39.013279 (+ 3308us) service_pool.cc:225] Handling call
1215 20:52:39.013540 (+ 261us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:39.430644 (+417104us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:42.923502 (+3492858us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540030f2d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:42.923790 (+ 288us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":957849344}
I20251215 20:52:42.944687 2743 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:42.944435 2679 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:42.945269 2679 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:42.945696 2679 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:42.947923 1687 leader_election.cc:336] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.637s (SENT)
I20251215 20:52:42.948410 1687 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:42.949203 2784 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.950201 1612 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:42.926175 2732 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.928951 2724 raft_consensus.cc:697] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:42.953481 2724 consensus_queue.cc:237] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.955475 2737 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:42.955942 2737 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:42.956355 2737 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.959033 2679 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:42.960100 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.951121 2690 raft_consensus.cc:2749] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:42.954046 1687 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.689s (SENT)
I20251215 20:52:42.962718 1793 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.912151 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.968209 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:42.968137 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.969846 1687 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:42.967088 1686 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: fbfdeb011a604f78a77f04be26573717
I20251215 20:52:42.929059 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.974455 1793 raft_consensus.cc:3060] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:42.974092 1794 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.971045 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.977051 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.977591 1639 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:42.978492 1644 raft_consensus.cc:1240] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:42.979674 1641 raft_consensus.cc:2393] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:42.980041 2771 raft_consensus.cc:2749] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.980758 1643 raft_consensus.cc:1275] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251215 20:52:42.981756 2626 raft_consensus.cc:2749] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:42.980927 1790 raft_consensus.cc:2393] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
W20251215 20:52:42.984284 1687 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.697s (SENT)
W20251215 20:52:42.985388 1687 leader_election.cc:336] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.724s (SENT)
W20251215 20:52:42.986003 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 74322.1us
I20251215 20:52:42.985224 1642 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:42.991031 1640 raft_consensus.cc:2468] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.992210 2679 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:42.992583 2778 raft_consensus.cc:2804] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:42.993022 2778 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:42.993561 2778 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:42.993742 2784 raft_consensus.cc:2749] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:42.985958 1687 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:42.992995 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.995224 1760 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:42.997300 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:42.998327 1794 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:42.966776 2765 raft_consensus.cc:2749] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.001672 2718 raft_consensus.cc:2804] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:43.002377 2718 raft_consensus.cc:697] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:43.002895 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.003089 1793 raft_consensus.cc:2468] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.003618 1791 raft_consensus.cc:2468] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:43.003415 2718 consensus_queue.cc:237] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.005653 1793 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:43.006253 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.007058 1791 raft_consensus.cc:1275] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:43.007391 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:43.007675 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:42.997370 2784 raft_consensus.cc:2749] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.008889 1641 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:43.010613 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.011289 1644 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.013875 1643 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:43.015161 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:43.017050 1789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46050 (request call id 860) took 2638 ms (client timeout 1576 ms). Trace:
I20251215 20:52:43.017194 2772 raft_consensus.cc:3055] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:43.017827 1667 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4e60 after lost signal to thread 1819
I20251215 20:52:42.991958 2763 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:43.017500 1789 rpcz_store.cc:269] 1215 20:52:40.378895 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:40.379097 (+ 202us) service_pool.cc:225] Handling call
1215 20:52:43.016696 (+2637599us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b5400351454. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:43.016837 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5553896192}
I20251215 20:52:43.029636 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.030388 1789 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:43.030532 1795 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:43.031286 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.032524 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.032676 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.033735 1795 raft_consensus.cc:2393] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:43.035391 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:43.036334 1788 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:43.018935 1794 raft_consensus.cc:1240] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.000216 2647 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.018553 2772 raft_consensus.cc:740] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
W20251215 20:52:43.041146 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 91003.3us
I20251215 20:52:43.041328 2772 consensus_queue.cc:260] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.041917 1686 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.042094 1612 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.042788 2772 raft_consensus.cc:3060] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.043543 1612 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:43.021921 1667 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa700 after lost signal to thread 2345
I20251215 20:52:43.015555 2258 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:43.022431 1687 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.756s (SENT)
I20251215 20:52:43.052358 2679 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20251215 20:52:43.053020 1687 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.788s (SENT)
I20251215 20:52:43.024489 1760 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.055958 2315 raft_consensus.cc:1275] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20251215 20:52:43.056859 1667 debug-util.cc:398] Leaking SignalData structure 0x7b08003aada0 after lost signal to thread 2706
I20251215 20:52:43.057763 2636 consensus_queue.cc:1048] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:43.054108 2780 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.025506 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.028622 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:43.053946 1787 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:43.062088 2258 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.062997 2756 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:43.063407 2756 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:43.063746 2756 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:43.053999 1687 leader_election.cc:336] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.812s (SENT)
I20251215 20:52:43.012457 1637 raft_consensus.cc:2468] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 3.
I20251215 20:52:43.065026 1687 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:43.053896 2784 consensus_queue.cc:1059] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20251215 20:52:43.065793 2775 raft_consensus.cc:2749] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.066133 2720 raft_consensus.cc:2749] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:43.066877 2720 raft_consensus.cc:3055] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:43.067245 2720 raft_consensus.cc:740] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.064518 2622 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:43.067765 2622 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:52:43.068208 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.069377 2777 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.046759 1792 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.046224 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:43.060786 1786 raft_consensus.cc:2368] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 2. Current term is 3.
I20251215 20:52:43.060518 2765 raft_consensus.cc:2804] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:42.965353 2612 consensus_queue.cc:260] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:43.074940 2735 raft_consensus.cc:2804] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:43.050923 1793 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:43.075867 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.076140 1639 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:43.068186 2622 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.076977 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:43.081794 1640 raft_consensus.cc:2393] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:43.082258 1644 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:43.082636 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:43.083686 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.084460 1646 raft_consensus.cc:1240] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:43.087553 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 44096.7us
W20251215 20:52:43.090211 2795 log.cc:927] Time spent T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.095s user 0.001s sys 0.001s
I20251215 20:52:43.074909 2765 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:43.091843 2765 raft_consensus.cc:3060] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.092625 1788 raft_consensus.cc:2393] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:43.082157 2750 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.095283 2763 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:43.094103 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:43.095235 1790 raft_consensus.cc:1240] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.097721 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.098480 1795 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:43.098325 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.098970 1794 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.100667 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.101008 2622 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.102017 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.101877 2778 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:43.102133 2756 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:43.102653 1791 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.068028 2720 consensus_queue.cc:260] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.103979 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.104442 2720 raft_consensus.cc:3060] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.104771 1793 raft_consensus.cc:2393] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:43.106362 1645 raft_consensus.cc:1240] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.078969 2612 ts_tablet_manager.cc:1434] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.371s user 0.009s sys 0.000s
W20251215 20:52:43.110242 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.110250 1760 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.083478 1686 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:43.118074 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.104879 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.117347 2670 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:43.124316 1792 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:43.124776 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.063827 2258 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:43.125322 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.125504 1640 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.103384 2622 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:43.087690 2735 raft_consensus.cc:697] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:43.127765 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:43.128036 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 74088.8us
I20251215 20:52:43.129916 1646 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.084698 2631 consensus_queue.cc:1059] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20251215 20:52:43.132143 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.132198 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.137302 1789 raft_consensus.cc:2393] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:43.111342 2756 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:43.138566 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.119575 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:43.135752 1793 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.140053 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.117682 2778 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:43.133980 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 58173.7us
I20251215 20:52:43.134866 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.140650 1788 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.141681 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.143889 1795 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.141002 1791 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.118969 2737 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.134820 2670 raft_consensus.cc:697] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.134034 1786 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:43.136811 2705 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:43.148066 2760 raft_consensus.cc:2804] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:43.149755 2735 consensus_queue.cc:237] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.133291 2626 consensus_queue.cc:1059] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20251215 20:52:43.153172 2750 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.150053 2760 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:43.155486 2760 raft_consensus.cc:3060] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.158671 2737 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:43.145256 2722 consensus_queue.cc:1059] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20251215 20:52:43.143827 2257 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57
W20251215 20:52:43.145844 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 80764.6us
I20251215 20:52:43.165074 2763 raft_consensus.cc:2804] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:43.165659 2763 raft_consensus.cc:697] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 3 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:43.148128 2312 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.166605 2763 consensus_queue.cc:237] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:43.170914 2750 consensus_queue.cc:1059] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:43.172024 2750 raft_consensus.cc:3055] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:43.154150 2780 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.172937 1646 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:43.173197 1760 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.174086 2743 raft_consensus.cc:2804] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.174451 2743 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:43.174772 2743 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.174963 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:43.166729 2670 consensus_queue.cc:237] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.174103 2642 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20251215 20:52:43.176677 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:43.178648 1645 raft_consensus.cc:1240] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.154284 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:43.180008 1787 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.180436 2320 raft_consensus.cc:1240] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 3. Ops: []
I20251215 20:52:43.182057 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:43.186875 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.187973 1787 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.188442 1612 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.189275 2737 raft_consensus.cc:2749] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.190408 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.191350 2750 raft_consensus.cc:740] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:43.197280 1656 tablet_copy_service.cc:342] P 9b3367a5854f49b98da54556a209b0de: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-668639c78eab435fb81c2471ddacf0db received from {username='slave'} at 127.0.0.1:59670
I20251215 20:52:43.197855 1656 tablet_copy_service.cc:434] P 9b3367a5854f49b98da54556a209b0de: ending tablet copy session fbfdeb011a604f78a77f04be26573717-668639c78eab435fb81c2471ddacf0db on tablet 668639c78eab435fb81c2471ddacf0db with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.198020 2750 consensus_queue.cc:260] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:43.200970 1687 leader_election.cc:336] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.935s (SENT)
I20251215 20:52:43.201449 1687 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:43.192114 1612 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.202576 2737 raft_consensus.cc:2749] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:43.200037 2765 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:43.203516 2775 consensus_queue.cc:1048] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:43.205818 2765 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:43.191995 1786 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:43.206995 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:43.190747 1760 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.209550 2320 raft_consensus.cc:2393] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:43.208971 2784 raft_consensus.cc:3055] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:43.212235 1760 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.212330 1686 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:43.211549 2784 raft_consensus.cc:740] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.216576 2631 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:43.219003 2631 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:43.219275 2722 raft_consensus.cc:3055] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:43.220566 2720 raft_consensus.cc:2804] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:43.220686 2722 raft_consensus.cc:740] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.221024 2626 consensus_queue.cc:1059] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:43.219420 2772 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.221786 2722 consensus_queue.cc:260] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.222841 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.223989 2320 raft_consensus.cc:1240] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.224968 2784 consensus_queue.cc:260] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.226027 2631 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:43.222985 2722 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.231010 2312 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
W20251215 20:52:43.219300 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 64604.4us
W20251215 20:52:43.233001 1687 leader_election.cc:336] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 1.975s (SENT)
I20251215 20:52:43.233474 1687 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.218389 2705 raft_consensus.cc:697] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:43.234964 2743 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:43.235467 1687 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.078s (SENT)
I20251215 20:52:43.235105 2772 raft_consensus.cc:2749] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.216414 2750 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.230058 2724 raft_consensus.cc:3055] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:43.238031 1760 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.240217 1646 raft_consensus.cc:2468] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:43.238171 1640 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 3.
W20251215 20:52:43.264008 1687 leader_election.cc:336] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.089s (SENT)
W20251215 20:52:43.254051 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.242233 1760 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.226168 2784 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.236377 2705 consensus_queue.cc:237] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.269162 1760 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.269996 1687 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:43.239841 2638 raft_consensus.cc:2749] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:43.242198 2724 raft_consensus.cc:740] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:43.265053 2718 raft_consensus.cc:2804] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.275069 2732 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.267441 2647 raft_consensus.cc:2804] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251215 20:52:43.285460 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 59851.8us
I20251215 20:52:43.238736 2765 consensus_queue.cc:1059] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20251215 20:52:43.270763 2772 raft_consensus.cc:2749] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.289718 1760 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.284791 2718 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:43.282008 2257 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:43.438129 2718 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.341920 1612 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.440347 2312 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Advancing to term 2
I20251215 20:52:43.314100 2806 raft_consensus.cc:3055] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:43.442126 2806 raft_consensus.cc:740] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.443491 2622 raft_consensus.cc:2749] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.443094 2806 consensus_queue.cc:260] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:43.319118 2802 log.cc:927] Time spent T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e: Append to log took a long time: real 0.112s user 0.001s sys 0.000s
I20251215 20:52:43.342793 2690 consensus_queue.cc:1048] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20251215 20:52:43.343012 2736 consensus_queue.cc:1048] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
W20251215 20:52:43.316615 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 52633us
I20251215 20:52:43.449342 1787 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 3.
W20251215 20:52:43.451572 1687 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Timed out: RequestConsensusVote RPC to 127.0.106.131:45401 timed out after 2.139s (SENT)
I20251215 20:52:43.283941 2732 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:52:43.410945 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.288268 2647 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:43.294171 2638 raft_consensus.cc:2804] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20251215 20:52:43.387465 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.452814 1687 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:43.294538 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.285121 2720 raft_consensus.cc:697] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.294342 1760 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:43.428890 2803 log.cc:927] Time spent T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.275s user 0.000s sys 0.002s
W20251215 20:52:43.373338 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:43.474123 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.434940 1786 raft_consensus.cc:3055] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:43.497170 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 202875us
I20251215 20:52:43.428124 2777 raft_consensus.cc:2749] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.303923 2765 raft_consensus.cc:2749] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.432552 2679 raft_consensus.cc:3055] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:43.500170 1760 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:43.352226 2804 log.cc:927] Time spent T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.187s user 0.000s sys 0.003s
I20251215 20:52:43.465865 2732 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.415946 2743 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.466442 2638 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:43.486433 2647 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.501207 2806 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.496343 2756 raft_consensus.cc:2804] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:43.443089 2631 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.508808 2705 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.341318 2776 consensus_queue.cc:1048] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.172s
I20251215 20:52:43.291718 2760 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:43.488883 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 217406us
I20251215 20:52:43.501683 1786 raft_consensus.cc:740] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
W20251215 20:52:43.512728 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.512043 2722 raft_consensus.cc:2749] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20251215 20:52:43.520177 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 68621.5us
I20251215 20:52:43.342187 2636 consensus_queue.cc:1048] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.174s
I20251215 20:52:43.508795 2679 raft_consensus.cc:740] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.348418 2724 consensus_queue.cc:260] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:43.521661 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.516364 2638 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.518059 2735 raft_consensus.cc:2804] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
W20251215 20:52:43.531068 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 189254us
I20251215 20:52:43.531798 1612 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.514948 1760 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.518708 2705 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:43.519558 2756 raft_consensus.cc:697] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 3 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:43.544015 1760 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.544441 1644 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:43.536078 1686 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.537928 2760 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:43.539057 2631 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.540719 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:43.554343 2724 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.543615 2756 consensus_queue.cc:237] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:43.557089 2320 raft_consensus.cc:1240] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.558879 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.544169 2705 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.569496 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:43.571578 1644 raft_consensus.cc:1240] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.552277 2626 raft_consensus.cc:2804] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:43.575461 1717 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:43.577479 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.526790 2720 consensus_queue.cc:237] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:43.609661 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 77915.6us
I20251215 20:52:43.577302 2818 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:43.613025 2818 raft_consensus.cc:697] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
W20251215 20:52:43.615383 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.619644 1644 raft_consensus.cc:1240] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.565483 2679 consensus_queue.cc:260] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.620611 2679 raft_consensus.cc:3060] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.621917 2638 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.614138 2818 consensus_queue.cc:237] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.620719 2722 consensus_queue.cc:1059] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20251215 20:52:43.551986 1786 consensus_queue.cc:260] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:43.577579 2631 raft_consensus.cc:2804] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.624679 1612 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.623953 2638 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:43.637558 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 101005us
I20251215 20:52:43.638490 1760 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.607437 2626 raft_consensus.cc:697] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.629241 2743 raft_consensus.cc:3060] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:43.641548 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.643520 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:43.671479 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.576583 2778 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20251215 20:52:43.644199 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.630874 1786 raft_consensus.cc:3060] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.629257 2722 raft_consensus.cc:3055] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:43.672183 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.674774 1646 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:43.677096 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 61716us
W20251215 20:52:43.677829 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.679132 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:43.680081 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:43.629572 2813 log.cc:927] Time spent T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20251215 20:52:43.673118 2775 raft_consensus.cc:2804] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
W20251215 20:52:43.681829 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:43.681510 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 48715us
I20251215 20:52:43.687827 1644 raft_consensus.cc:1275] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:43.635106 2631 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:43.624229 2647 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.632249 2636 consensus_queue.cc:1059] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20251215 20:52:43.682551 1712 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:43.706871 1646 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:43.677147 2722 raft_consensus.cc:740] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
W20251215 20:52:43.701084 2816 log.cc:927] Time spent T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.127s user 0.001s sys 0.000s
I20251215 20:52:43.693638 2775 raft_consensus.cc:697] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:43.717717 1646 raft_consensus.cc:1275] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:43.714310 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.705704 2631 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.715531 1760 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.707325 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:43.706535 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 255476us
W20251215 20:52:43.731664 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.707022 2823 raft_consensus.cc:2749] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.735734 1642 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.738525 2647 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.740720 2775 consensus_queue.cc:237] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.741863 2705 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:43.745139 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.711031 2679 consensus_queue.cc:1059] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20251215 20:52:43.734447 2812 log.cc:927] Time spent T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.202s user 0.001s sys 0.000s
I20251215 20:52:43.715665 2750 consensus_queue.cc:1048] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20251215 20:52:43.768368 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 57066us
I20251215 20:52:43.735405 2638 raft_consensus.cc:2804] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
W20251215 20:52:43.773590 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 84023.1us
I20251215 20:52:43.769912 2736 raft_consensus.cc:3055] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:43.783250 2826 consensus_queue.cc:1048] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20251215 20:52:43.785476 1612 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.787293 1612 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.780356 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:43.788434 2811 log.cc:927] Time spent T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.221s user 0.001s sys 0.001s
I20251215 20:52:43.783164 2736 raft_consensus.cc:740] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:43.791515 2636 raft_consensus.cc:2749] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.791668 2776 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:43.796900 2776 raft_consensus.cc:697] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:43.797456 2705 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.797937 2776 consensus_queue.cc:237] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:43.801141 1644 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251215 20:52:43.797920 2743 raft_consensus.cc:2749] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:43.794893 2736 consensus_queue.cc:260] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:43.806053 2638 raft_consensus.cc:697] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:43.841886 1786 raft_consensus.cc:1275] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:43.842509 2638 consensus_queue.cc:237] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.845085 2312 raft_consensus.cc:1240] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.846619 2736 raft_consensus.cc:3060] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.748045 2722 consensus_queue.cc:260] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:43.810227 2821 log.cc:927] Time spent T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.078s user 0.000s sys 0.001s
I20251215 20:52:43.766230 2626 consensus_queue.cc:237] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:43.849181 2722 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.822929 2808 raft_consensus.cc:3055] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:43.788477 1792 raft_consensus.cc:3060] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.823271 2760 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20251215 20:52:43.823884 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.792464 1612 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:43.862687 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 70309.3us
I20251215 20:52:43.790848 1642 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:43.829799 2258 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.833483 2732 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.835814 2718 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:43.867847 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.868400 1612 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.874792 1641 raft_consensus.cc:1240] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.852996 2735 raft_consensus.cc:697] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:43.877241 1760 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.861131 2808 raft_consensus.cc:740] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:43.869325 2818 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.883116 2818 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:43.883375 2631 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:43.895403 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.895963 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.896715 1644 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.887869 1792 raft_consensus.cc:2468] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:43.905923 1612 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.907033 1612 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.909415 1612 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.909504 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.910346 1640 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.880775 2763 raft_consensus.cc:2749] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.889477 2732 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.883514 2818 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.889660 2777 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:43.884091 1637 raft_consensus.cc:1240] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:43.892156 1643 raft_consensus.cc:1275] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:43.917054 1612 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:43.885718 2631 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.889560 2718 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:43.889387 2808 consensus_queue.cc:260] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.921061 2835 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:43.939318 1644 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:43.921797 2735 consensus_queue.cc:237] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:43.940539 1760 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:43.929273 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.942904 1792 raft_consensus.cc:2393] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:43.919473 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:43.939981 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.930222 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:43.890336 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 60649.5us
I20251215 20:52:43.878719 2784 consensus_queue.cc:1059] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20251215 20:52:43.914875 2737 raft_consensus.cc:2804] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.935444 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.948529 1793 raft_consensus.cc:2376] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4. Re-sending same reply.
I20251215 20:52:43.930148 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.937140 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.937623 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.938256 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.938735 2690 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.939652 2808 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:43.943825 1795 raft_consensus.cc:2376] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2. Re-sending same reply.
I20251215 20:52:43.944399 1794 raft_consensus.cc:2393] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:43.946142 1612 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:43.939595 2835 raft_consensus.cc:697] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:43.951347 1791 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:43.951267 1789 raft_consensus.cc:2376] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2. Re-sending same reply.
I20251215 20:52:43.951893 1788 raft_consensus.cc:2376] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2. Re-sending same reply.
W20251215 20:52:43.972414 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:43.945884 2636 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.975560 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.985728 1793 raft_consensus.cc:2393] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:43.989028 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:43.989584 1792 raft_consensus.cc:2376] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2. Re-sending same reply.
I20251215 20:52:43.949142 1642 raft_consensus.cc:1275] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:43.948019 2718 raft_consensus.cc:2804] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:43.917555 2775 raft_consensus.cc:2804] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:43.950001 2737 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:43.936054 2722 consensus_queue.cc:1059] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20251215 20:52:43.952052 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:44.144683 1790 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:44.011092 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:44.145176 2818 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.145798 1793 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
W20251215 20:52:44.011641 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 75178.6us
I20251215 20:52:44.147207 2818 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.147452 1612 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: fbfdeb011a604f78a77f04be26573717
I20251215 20:52:44.147861 2818 consensus_queue.cc:1048] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:44.148656 1612 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:44.149253 2818 raft_consensus.cc:2764] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20251215 20:52:44.150113 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 94141.2us
I20251215 20:52:44.151556 2722 raft_consensus.cc:3055] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:44.151829 1544 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45280 (request call id 187) took 3796 ms. Trace:
W20251215 20:52:44.137897 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 126488us
I20251215 20:52:44.012847 2832 consensus_queue.cc:1059] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.121s
I20251215 20:52:44.014700 1640 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
W20251215 20:52:44.039486 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.153667 2832 raft_consensus.cc:3055] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:44.154053 2832 raft_consensus.cc:740] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:44.151587 1543 catalog_manager.cc:5654] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:44.057317 2690 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:44.054466 2636 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:52:44.076538 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.158562 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.159044 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.105612 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.160454 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.011546 2775 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:44.056742 2718 raft_consensus.cc:697] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:44.048326 1795 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20251215 20:52:44.062995 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 49451.7us
W20251215 20:52:44.064774 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.047076 2737 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.011231 2776 raft_consensus.cc:2749] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:44.012544 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:44.153264 2722 raft_consensus.cc:740] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:44.127435 1791 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:44.052069 2835 consensus_queue.cc:237] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.115157 1787 raft_consensus.cc:1275] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251215 20:52:44.138757 2807 consensus_queue.cc:1048] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
W20251215 20:52:44.139986 2839 log.cc:927] Time spent T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.129s user 0.000s sys 0.000s
I20251215 20:52:44.162452 1646 raft_consensus.cc:1275] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:44.152273 1544 rpcz_store.cc:276] 1215 20:52:40.355095 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:40.356459 (+ 1364us) service_pool.cc:225] Handling call
1215 20:52:44.151729 (+3795270us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:43.018134 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:43.054840 (+ 36706us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:43.054913 (+ 73us) write_op.cc:435] Acquired schema lock
1215 20:52:43.054951 (+ 38us) tablet.cc:660] Decoding operations
1215 20:52:43.055713 (+ 762us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:43.055805 (+ 92us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:43.055835 (+ 30us) tablet.cc:683] Acquiring locks for 5 operations
1215 20:52:43.056535 (+ 700us) tablet.cc:699] Row locks acquired
1215 20:52:43.056569 (+ 34us) write_op.cc:260] PREPARE: finished
1215 20:52:43.056737 (+ 168us) write_op.cc:270] Start()
1215 20:52:43.056907 (+ 170us) write_op.cc:276] Timestamp: P: 1765831963056671 usec, L: 0
1215 20:52:43.056943 (+ 36us) op_driver.cc:348] REPLICATION: starting
1215 20:52:43.057660 (+ 717us) log.cc:844] Serialized 2093 byte log entry
1215 20:52:43.318111 (+260451us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b440002304c. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bab5bed5 00007f30bab5c8f2 00007f30bd8a657b 00007f30bd8a1e4f 00007f30bd895c0e 00007f30bd894f56 00007f30bd894b78 00007f30bd89e5c1 00007f30bd89e579 00007f30bd89e509
1215 20:52:43.553620 (+235509us) op_driver.cc:464] REPLICATION: finished
1215 20:52:43.783275 (+229655us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b440002304c. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bab5bed5 00007f30bab5c8f2 00007f30bd8a657b 00007f30bd8a1e4f 00007f30bac2fc1c 00007f30c3a177e9 00007f30bac4c28b 00007f30bac4a52f 00007f30bac4c7f2 00007f30c1733e40
1215 20:52:43.929799 (+146524us) write_op.cc:301] APPLY: starting
1215 20:52:43.929920 (+ 121us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:43.930093 (+ 173us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:43.930132 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:44.082292 (+152160us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:44.082586 (+ 294us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
1215 20:52:44.082659 (+ 73us) write_op.cc:312] APPLY: finished
1215 20:52:44.082995 (+ 336us) log.cc:844] Serialized 46 byte log entry
1215 20:52:44.083234 (+ 239us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:44.083357 (+ 123us) write_op.cc:454] Released schema lock
1215 20:52:44.083439 (+ 82us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:44.083841 (+ 402us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:44.083877 (+ 36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":363977,"apply.run_cpu_time_us":3437,"apply.run_wall_time_us":154049,"num_ops":5,"prepare.queue_time_us":131249,"prepare.run_cpu_time_us":21802,"prepare.run_wall_time_us":116383,"raft.queue_time_us":107659,"raft.run_cpu_time_us":18676,"raft.run_wall_time_us":322453,"replication_time_us":496505,"spinlock_wait_cycles":85048320,"thread_start_us":548909,"threads_started":4,"wal-append.queue_time_us":148550}]]}
I20251215 20:52:44.180688 2670 consensus_queue.cc:1059] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20251215 20:52:44.170428 2778 consensus_queue.cc:1048] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20251215 20:52:44.164887 1760 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:44.155743 1543 catalog_manager.cc:5654] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
W20251215 20:52:44.170387 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.173779 1792 raft_consensus.cc:2376] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2. Re-sending same reply.
I20251215 20:52:44.069900 2809 raft_consensus.cc:3055] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:44.165796 2818 raft_consensus.cc:2764] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20251215 20:52:44.168984 2775 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.166795 2636 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.164149 1640 raft_consensus.cc:1275] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:44.194335 2258 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.201512 1543 catalog_manager.cc:5654] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 1 to 3, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 3 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:44.198197 2809 raft_consensus.cc:740] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:44.165901 2679 consensus_queue.cc:1059] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20251215 20:52:44.217003 1793 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251215 20:52:44.202850 2735 raft_consensus.cc:2804] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:44.154899 2832 consensus_queue.cc:260] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:44.228130 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.209178 2642 raft_consensus.cc:2804] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:44.235945 1687 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.201444 2760 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20251215 20:52:44.222344 2756 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20251215 20:52:44.204660 2631 consensus_queue.cc:1048] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20251215 20:52:44.206784 2732 consensus_queue.cc:1048] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20251215 20:52:44.242090 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 66951.1us
I20251215 20:52:44.286319 1687 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.236160 2735 raft_consensus.cc:697] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:44.300551 1687 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.242466 1787 raft_consensus.cc:1275] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251215 20:52:44.321134 1687 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.242834 2626 consensus_queue.cc:1059] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20251215 20:52:44.294139 2778 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:44.320097 2772 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:44.330241 2772 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:44.316419 2679 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:44.235208 2722 consensus_queue.cc:260] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.333693 1644 raft_consensus.cc:1275] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:44.330742 2772 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.312229 2736 consensus_queue.cc:1048] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20251215 20:52:44.331106 2832 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:44.329018 2778 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:44.243764 2718 consensus_queue.cc:237] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.369228 1641 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251215 20:52:44.335808 2720 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:44.370864 1687 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.340710 2638 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.290056 2809 consensus_queue.cc:260] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:44.372941 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 51254.2us
I20251215 20:52:44.329504 2806 consensus_queue.cc:1059] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20251215 20:52:44.376813 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.399303 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.340495 2743 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:44.344631 2705 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:44.416695 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.410135 1687 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:44.412809 2845 log.cc:927] Time spent T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.104s user 0.000s sys 0.000s
I20251215 20:52:44.413354 2312 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:44.413888 2809 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:44.414624 2853 consensus_queue.cc:1059] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:44.364148 2642 raft_consensus.cc:697] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:44.419023 1687 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.420642 2859 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:44.422075 2647 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.424378 2806 raft_consensus.cc:2749] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:44.420248 2835 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.420504 2829 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:44.425128 2847 log.cc:927] Time spent T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20251215 20:52:44.425336 2833 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:44.426317 2849 log.cc:927] Time spent T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.110s user 0.000s sys 0.000s
W20251215 20:52:44.427160 2848 log.cc:927] Time spent T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.133s user 0.001s sys 0.000s
I20251215 20:52:44.409365 2670 raft_consensus.cc:1064] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:44.371693 2778 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.404908 2626 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.373147 2720 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:44.430866 1687 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: fbfdeb011a604f78a77f04be26573717
I20251215 20:52:44.372020 2732 consensus_queue.cc:1048] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20251215 20:52:44.431293 2808 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.471751 1687 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.409116 2638 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.423859 2760 consensus_queue.cc:1048] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20251215 20:52:44.449304 2722 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:44.420058 2743 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.485338 2861 raft_consensus.cc:3055] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:44.422312 2705 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.472415 2784 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.478678 2720 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.471163 2806 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:44.435643 2647 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.452687 2835 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.408883 2735 consensus_queue.cc:237] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:44.505043 1609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 163166us
I20251215 20:52:44.489884 2861 raft_consensus.cc:740] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:44.457304 2829 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.478246 2626 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.500147 2806 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:44.489058 2808 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.487107 2642 consensus_queue.cc:237] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.460304 2833 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.509874 1642 raft_consensus.cc:1240] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:44.524096 2743 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:44.525519 2705 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:44.499478 2784 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.542907 2784 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.543507 2784 raft_consensus.cc:2804] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:44.543865 2784 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:44.527551 2647 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:44.544224 2784 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:44.540980 2832 raft_consensus.cc:2804] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:44.548146 2833 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:44.548513 2832 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:44.548997 2832 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.549418 2638 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:44.551187 2808 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.552598 2647 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.552919 2626 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.553099 2647 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:44.554848 2312 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 1 LEARNER]: Advancing to term 2
I20251215 20:52:44.555217 2647 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:44.551970 2670 consensus_queue.cc:237] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.523535 2861 consensus_queue.cc:260] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.520598 2806 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.565367 2636 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.569327 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:44.566079 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.566488 2829 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.544247 2835 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:44.571561 1793 raft_consensus.cc:2393] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:44.569425 1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.566738 2765 raft_consensus.cc:3055] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:44.570415 2808 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.570876 2679 raft_consensus.cc:2749] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:44.592475 1646 raft_consensus.cc:1240] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20251215 20:52:44.594985 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:44.591811 2807 raft_consensus.cc:3055] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:44.589293 2765 raft_consensus.cc:740] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:44.606678 1640 raft_consensus.cc:1275] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251215 20:52:44.589802 2626 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20251215 20:52:44.598448 2808 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.603931 2807 raft_consensus.cc:740] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:44.618723 2679 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.619402 2679 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.623996 2835 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.624558 2835 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.624887 2636 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.626461 2835 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:44.628607 2807 consensus_queue.cc:260] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.629849 2807 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:44.630813 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.612735 2720 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:44.646878 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.614334 2772 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:44.654189 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.614705 2257 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.659797 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.660528 1645 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:44.639017 2626 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.623103 2737 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.628186 2806 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.669785 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.670986 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.675216 2320 raft_consensus.cc:1275] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 LEARNER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251215 20:52:44.677570 2859 raft_consensus.cc:2749] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:44.678399 2832 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.630457 2765 consensus_queue.cc:260] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.682591 2720 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.683454 2832 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:44.686131 2765 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:44.635149 2670 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20251215 20:52:44.688439 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.688877 1645 raft_consensus.cc:2393] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:44.696249 2315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:44.696588 2772 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.689086 1646 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:44.699786 1646 raft_consensus.cc:1275] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20251215 20:52:44.708170 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 236483us
I20251215 20:52:44.709203 1687 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.712473 1645 raft_consensus.cc:1240] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:44.714609 1646 raft_consensus.cc:1275] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:44.673116 2829 raft_consensus.cc:3060] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:44.738948 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.739853 1645 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:44.749073 1643 raft_consensus.cc:1240] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Rejecting Update request from peer fbfdeb011a604f78a77f04be26573717 for earlier term 2. Current term is 3. Ops: []
W20251215 20:52:44.672799 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 61938.1us
I20251215 20:52:44.758092 1687 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.673044 2626 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.711938 2808 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.766856 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:44.768700 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
W20251215 20:52:44.773947 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.776147 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.755558 2859 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:44.791738 1687 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.780215 2312 raft_consensus.cc:1275] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 2 LEARNER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251215 20:52:44.790391 1686 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:44.797628 1686 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:44.802263 1686 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:44.803196 2772 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:44.803637 2772 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:44.803988 2772 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.780987 2859 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:44.807825 2859 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:44.808715 1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.809098 2737 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:44.792618 2870 raft_consensus.cc:2749] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:44.816535 2833 raft_consensus.cc:2749] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:44.818405 2772 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.824805 2808 consensus_queue.cc:1059] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:44.825336 1687 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:44.828682 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 497156us
I20251215 20:52:44.749218 2869 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
W20251215 20:52:44.833547 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 396788us
I20251215 20:52:44.828683 2737 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.798743 2679 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.845403 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.846843 1645 raft_consensus.cc:2393] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:44.847740 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:44.861194 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.861717 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.862056 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:44.864042 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.835594 2832 raft_consensus.cc:2749] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:44.827271 2778 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:44.870353 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:44.875913 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 73738.2us
I20251215 20:52:44.864351 2631 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.885113 2631 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.886097 1643 raft_consensus.cc:1275] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:44.887555 2631 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:44.864683 2679 raft_consensus.cc:2804] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:44.888772 1612 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:44.889402 1639 raft_consensus.cc:2468] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:44.865571 2638 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.889001 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:44.941702 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:44.941553 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 52876.2us
I20251215 20:52:44.943622 1645 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:44.950793 1686 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:44.952278 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 59403.4us
I20251215 20:52:44.857812 2818 consensus_queue.cc:1059] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20251215 20:52:44.859694 2737 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:44.890421 2720 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.888638 2718 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.891096 2670 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.960726 2315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:44.961087 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 164105us
W20251215 20:52:44.961783 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 136491us
I20251215 20:52:45.212893 1687 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:44.967916 2778 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.004066 2870 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:44.998384 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:45.073830 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:45.218055 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.217829 1687 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:45.004123 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:44.998678 2772 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:44.881366 2736 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
W20251215 20:52:45.057878 2784 consensus_meta.cc:287] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.513s user 0.009s sys 0.000s
W20251215 20:52:45.262603 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 44853.8us
I20251215 20:52:45.220546 2835 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:44.891417 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:45.275681 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 59066.4us
I20251215 20:52:44.970368 2732 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:44.998394 2735 consensus_queue.cc:1048] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20251215 20:52:44.952142 2631 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:45.182228 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 226152us
W20251215 20:52:45.062630 2775 consensus_meta.cc:287] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.854s user 0.011s sys 0.001s
I20251215 20:52:45.031117 2765 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:45.091310 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:44.998749 1760 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:45.012099 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.062992 2626 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:45.117110 2875 log.cc:927] Time spent T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.086s user 0.000s sys 0.001s
I20251215 20:52:44.971312 2679 raft_consensus.cc:697] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:44.952803 2638 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:45.112460 2873 log.cc:927] Time spent T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.159s user 0.000s sys 0.001s
I20251215 20:52:45.170742 2861 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:44.997537 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.280915 2765 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:45.051925 2808 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.298229 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:45.297812 1542 catalog_manager.cc:5654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:45.298961 1646 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.893383 2832 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:44.956458 2809 consensus_queue.cc:1048] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20251215 20:52:45.062628 2869 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.306262 2869 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.093359 2889 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:45.312777 2808 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.313561 2889 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:45.315101 2808 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.315825 2889 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:44.872609 2647 consensus_queue.cc:1059] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20251215 20:52:44.953470 2833 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20251215 20:52:44.869647 2642 consensus_queue.cc:1048] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20251215 20:52:45.201292 2872 raft_consensus.cc:3055] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:45.319567 2872 raft_consensus.cc:740] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:45.301676 2626 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.203853 2866 raft_consensus.cc:3055] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:45.204499 1609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 111120us
I20251215 20:52:45.320497 2626 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:45.183884 2847 log.cc:927] Time spent T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20251215 20:52:45.131830 2760 consensus_queue.cc:1059] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20251215 20:52:45.183735 2892 log.cc:927] Time spent T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.066s user 0.000s sys 0.001s
I20251215 20:52:45.322021 2818 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:45.183955 2884 log.cc:927] Time spent T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.230s user 0.000s sys 0.001s
I20251215 20:52:45.302038 2832 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:45.220927 1645 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:45.217763 2806 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.214267 2670 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.296392 2868 raft_consensus.cc:2804] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:45.337102 2868 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:45.337517 2868 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:45.337868 2670 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.206527 2829 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:45.259090 1795 raft_consensus.cc:1275] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:45.338567 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:45.220181 2315 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:45.339177 2760 raft_consensus.cc:3055] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:45.339643 2760 raft_consensus.cc:740] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:45.339999 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:45.341207 2315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:45.323305 2832 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:44.970548 2874 raft_consensus.cc:2749] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:45.158463 2859 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.262368 2737 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:45.280112 1612 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:45.344959 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 64934.4us
I20251215 20:52:45.339471 1645 raft_consensus.cc:2410] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20251215 20:52:45.347627 1612 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:45.347317 2868 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.348433 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:45.349727 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:45.280531 1687 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:45.214666 2718 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.214366 2720 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:45.225963 2870 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.280332 2863 raft_consensus.cc:2804] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:45.264748 2784 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.297317 1637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 963) took 1065 ms. Trace:
I20251215 20:52:45.298434 2638 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:44.952713 2856 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.300138 1542 catalog_manager.cc:5654] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:45.304668 1543 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45274 (request call id 192) took 2831 ms. Trace:
I20251215 20:52:45.278925 2835 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.313953 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:52:45.198997 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:45.323488 2866 raft_consensus.cc:740] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:45.282508 2775 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.399336 2775 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.400238 1640 raft_consensus.cc:2393] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:45.402482 2784 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.340576 2760 consensus_queue.cc:260] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:45.404942 2893 log.cc:927] Time spent T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
W20251215 20:52:45.406776 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 432426us
I20251215 20:52:45.407701 1760 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:45.395471 1542 catalog_manager.cc:5654] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:45.345062 2859 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.324450 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:45.289811 2823 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.299930 2765 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:45.415458 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 62338.6us
I20251215 20:52:45.282274 2631 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.299221 2679 consensus_queue.cc:237] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.326877 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:45.418071 1639 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
W20251215 20:52:45.328269 2881 log.cc:927] Time spent T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.122s user 0.000s sys 0.001s
I20251215 20:52:45.328992 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:45.421248 1717 raft_consensus.cc:1275] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:45.322754 2626 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:45.329031 2647 raft_consensus.cc:3055] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:45.322693 2818 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.335843 2869 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.340117 1758 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:45.227425 2807 raft_consensus.cc:2749] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:45.347324 1646 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:45.363752 2852 consensus_queue.cc:1048] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20251215 20:52:45.362643 1684 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:45.280521 2732 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:45.381201 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 100728us
I20251215 20:52:45.457795 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:45.459677 1687 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:45.359233 2850 raft_consensus.cc:2749] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:45.360049 2670 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.362236 2737 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:45.397245 2896 log.cc:927] Time spent T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.078s user 0.002s sys 0.000s
I20251215 20:52:45.397037 2866 consensus_queue.cc:260] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.416342 1716 raft_consensus.cc:1275] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:45.382781 2868 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:45.422494 1686 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:45.422945 1721 raft_consensus.cc:1240] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:45.394559 2636 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:45.426097 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:45.396273 2863 raft_consensus.cc:697] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:45.411620 2778 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:45.320508 2872 consensus_queue.cc:260] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:45.455293 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 92745.6us
W20251215 20:52:45.485987 1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.391521 2853 consensus_queue.cc:1059] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20251215 20:52:45.458237 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:45.458673 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:45.423473 2763 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20251215 20:52:45.487246 1758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 147192us
I20251215 20:52:45.461570 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:45.487957 1646 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:45.386443 1543 rpcz_store.cc:276] 1215 20:52:42.473418 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:42.473718 (+ 300us) service_pool.cc:225] Handling call
1215 20:52:45.304587 (+2830869us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:44.370177 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:44.508038 (+137861us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:44.510309 (+ 2271us) write_op.cc:435] Acquired schema lock
1215 20:52:44.512672 (+ 2363us) tablet.cc:660] Decoding operations
1215 20:52:44.565831 (+ 53159us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:44.565889 (+ 58us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:44.565917 (+ 28us) tablet.cc:683] Acquiring locks for 3 operations
1215 20:52:44.566253 (+ 336us) tablet.cc:699] Row locks acquired
1215 20:52:44.566274 (+ 21us) write_op.cc:260] PREPARE: finished
1215 20:52:44.566419 (+ 145us) write_op.cc:270] Start()
1215 20:52:44.566577 (+ 158us) write_op.cc:276] Timestamp: P: 1765831964566378 usec, L: 0
1215 20:52:44.566598 (+ 21us) op_driver.cc:348] REPLICATION: starting
1215 20:52:44.603589 (+ 36991us) log.cc:844] Serialized 1311 byte log entry
1215 20:52:44.942932 (+339343us) op_driver.cc:464] REPLICATION: finished
1215 20:52:45.117170 (+174238us) write_op.cc:301] APPLY: starting
1215 20:52:45.117264 (+ 94us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:45.117425 (+ 161us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:45.140840 (+ 23415us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:45.159310 (+ 18470us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:45.159499 (+ 189us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
1215 20:52:45.159559 (+ 60us) write_op.cc:312] APPLY: finished
1215 20:52:45.159860 (+ 301us) log.cc:844] Serialized 34 byte log entry
1215 20:52:45.160077 (+ 217us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:45.160175 (+ 98us) write_op.cc:454] Released schema lock
1215 20:52:45.160220 (+ 45us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:45.160638 (+ 418us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:45.160672 (+ 34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45100,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":163976,"apply.run_cpu_time_us":2986,"apply.run_wall_time_us":43445,"num_ops":3,"prepare.queue_time_us":101790,"prepare.run_cpu_time_us":4777,"prepare.run_wall_time_us":265325,"replication_time_us":321760,"thread_start_us":162257,"threads_started":2}]]}
I20251215 20:52:45.462837 1718 raft_consensus.cc:1275] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:45.412343 2316 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:45.459758 1719 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:45.414862 2897 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:45.427366 2647 raft_consensus.cc:740] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
W20251215 20:52:45.475692 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 53277.5us
I20251215 20:52:45.496816 1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 804) took 1039 ms. Trace:
W20251215 20:52:45.476321 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.492897 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:45.483094 1687 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:45.462222 2809 raft_consensus.cc:2749] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:45.406890 2856 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:45.504979 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:45.474643 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:45.481942 1721 raft_consensus.cc:1240] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:45.501346 1686 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:45.502146 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.497289 1644 rpcz_store.cc:276] 1215 20:52:44.456890 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:44.456991 (+ 101us) service_pool.cc:225] Handling call
1215 20:52:44.457321 (+ 330us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:44.567159 (+109838us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:44.567189 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:44.570889 (+ 3700us) log.cc:844] Serialized 26 byte log entry
1215 20:52:44.888907 (+318018us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:44.888946 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:44.889011 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:45.496564 (+607553us) raft_consensus.cc:1685] finished
1215 20:52:45.496591 (+ 27us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:45.496741 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19054,"raft.queue_time_us":75556,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":11923,"thread_start_us":396712,"threads_started":2,"wal-append.queue_time_us":537930}
I20251215 20:52:45.488924 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:45.505271 1789 raft_consensus.cc:1240] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:45.484807 2807 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:45.480592 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:45.557662 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 74649.9us
I20251215 20:52:45.508345 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:45.561179 1795 raft_consensus.cc:2368] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:45.561060 1687 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:45.561866 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:45.518437 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.497035 2626 raft_consensus.cc:2804] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:45.508024 1684 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:45.562299 1793 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:45.486909 2869 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:45.576999 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 75720.2us
I20251215 20:52:45.470434 2670 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.580415 1686 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:45.578133 2626 raft_consensus.cc:697] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:45.599140 2863 consensus_queue.cc:237] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:45.600116 1687 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:45.578605 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 70665.2us
I20251215 20:52:45.615636 1719 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:45.493350 2897 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:45.493132 2889 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.500001 2859 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.499574 2638 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:45.417351 2823 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:45.500123 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:45.626266 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 45948.5us
I20251215 20:52:45.488402 2636 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.560238 2874 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.574121 2807 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:45.574630 2872 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:45.700201 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.694003 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:45.579371 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:45.714365 1721 raft_consensus.cc:1240] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:45.737226 1644 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:45.615608 2778 raft_consensus.cc:2749] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:45.714362 1718 raft_consensus.cc:1240] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
W20251215 20:52:45.681303 2886 log.cc:927] Time spent T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.121s user 0.000s sys 0.000s
I20251215 20:52:45.684584 2833 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:45.723292 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:45.724691 2877 log.cc:927] Time spent T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.134s user 0.000s sys 0.000s
I20251215 20:52:45.600140 2856 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.600950 2809 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:45.599287 2806 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:45.716480 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:45.749805 2736 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:45.681596 1790 raft_consensus.cc:1240] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:45.780892 2736 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.696225 2808 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:45.598984 2869 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.711575 2722 raft_consensus.cc:2804] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:45.753602 1794 raft_consensus.cc:1240] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:45.751931 2720 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:45.693397 2772 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:45.759147 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 182502us
I20251215 20:52:45.759824 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:45.602092 2642 consensus_queue.cc:1048] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20251215 20:52:45.629680 2897 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:45.712775 2638 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:45.764708 2907 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.765447 1715 raft_consensus.cc:1240] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:45.734133 2807 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:45.767993 1721 raft_consensus.cc:1275] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251215 20:52:45.770759 2636 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.765473 2626 consensus_queue.cc:237] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.724409 2889 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.968024 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.008378 1644 raft_consensus.cc:2393] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:46.008209 1717 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:45.723172 2859 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.780783 1795 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:45.909054 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.009961 2784 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.849634 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:45.818148 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.759194 2833 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:45.694705 2647 consensus_queue.cc:260] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:45.836006 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 262247us
I20251215 20:52:45.382238 1637 rpcz_store.cc:276] 1215 20:52:44.232347 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:44.232506 (+ 159us) service_pool.cc:225] Handling call
1215 20:52:44.247873 (+ 15367us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:44.317256 (+ 69383us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:44.318785 (+ 1529us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:44.414588 (+ 95803us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b2c00000658. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bc5f99b1 00007f30bc608fe2 00007f30bdd36851 00007f30bdcfb0ba 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22
1215 20:52:44.415039 (+ 451us) log.cc:844] Serialized 26 byte log entry
1215 20:52:44.424083 (+ 9044us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b4800001d58. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30c2c14e21 00007f30c2c0beb7 00007f30c2c0bd4a 00007f30c2d02f7f 00007f30c2d02c47 00007f30c2d1726c 00007f30c2d17218 00007f30c2d17198 00007f30c2d17153 00007f30c2d163fc 00007f30c1c51516
1215 20:52:44.803104 (+379021us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:44.815024 (+ 11920us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:44.815114 (+ 90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:45.297047 (+481933us) raft_consensus.cc:1685] finished
1215 20:52:45.297076 (+ 29us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:45.297229 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":22633,"raft.run_cpu_time_us":2382,"raft.run_wall_time_us":88800,"spinlock_wait_cycles":56358656,"thread_start_us":381510,"threads_started":1,"wal-append.queue_time_us":457987}
I20251215 20:52:46.016271 2868 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:46.016848 2868 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.017287 1637 raft_consensus.cc:1275] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20251215 20:52:46.023608 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.908912 2670 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.851445 2835 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:46.015077 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:46.027498 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.028383 1713 raft_consensus.cc:1240] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20251215 20:52:46.028765 2835 consensus_queue.cc:1048] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251215 20:52:45.849618 2904 log.cc:927] Time spent T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
W20251215 20:52:45.976737 1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:45.780642 2806 raft_consensus.cc:697] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:46.030823 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:46.031500 1645 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:46.031385 2806 consensus_queue.cc:237] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.032836 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:46.034320 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:46.035759 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:46.036314 1716 raft_consensus.cc:2410] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20251215 20:52:46.037891 1643 raft_consensus.cc:1275] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:46.040989 1760 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:46.013825 2784 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.014933 2833 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:45.944641 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:46.041694 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:45.836589 2852 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:45.755607 1642 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:45.961720 2722 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
W20251215 20:52:45.780694 2815 log.cc:927] Time spent T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.170s user 0.001s sys 0.000s
W20251215 20:52:46.009538 1792 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s user 0.004s sys 0.006s
I20251215 20:52:46.043901 1795 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
W20251215 20:52:46.079391 1792 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s user 0.004s sys 0.006s
I20251215 20:52:46.067042 1721 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:45.911288 2736 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:45.756664 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 292447us
I20251215 20:52:45.953229 2732 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:45.962250 2809 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:46.124712 2809 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.009780 2720 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:45.767381 2870 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.851702 2818 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.114058 2319 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:46.028788 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:46.011369 2638 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.026602 2670 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20251215 20:52:45.760915 2718 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:46.156919 2718 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:46.157495 2718 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:45.778179 2823 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:45.837342 2631 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:46.069041 2636 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:46.129253 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:46.161494 1792 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.161406 2636 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:46.164541 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.131009 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:46.096657 2722 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:46.192847 1792 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:46.011896 2772 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.074288 2907 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:46.137799 2918 consensus_queue.cc:1048] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20251215 20:52:46.145975 1684 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters:
W20251215 20:52:46.153735 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 144449us
I20251215 20:52:46.141783 2853 raft_consensus.cc:1064] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:46.228955 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 83063.9us
I20251215 20:52:46.237672 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:46.143488 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:46.238758 1795 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:46.079802 2852 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.164119 2636 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:45.766789 2874 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.166153 2897 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.149333 2720 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.267257 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:46.306895 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 76336.2us
I20251215 20:52:46.308415 1640 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:46.250221 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.309857 1721 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:46.310194 1791 raft_consensus.cc:2368] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4.
I20251215 20:52:46.139824 2916 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:46.314167 2636 consensus_queue.cc:1059] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20251215 20:52:46.267688 2319 raft_consensus.cc:1240] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:46.322847 1639 raft_consensus.cc:1275] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20251215 20:52:46.325842 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 218526us
W20251215 20:52:46.260993 2853 raft_consensus.cc:1068] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
W20251215 20:52:46.327560 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.284602 2775 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:46.267895 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:46.281420 2736 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:46.314783 2872 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:46.319216 2916 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:52:46.330278 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.315560 2806 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:46.358783 1640 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:46.281900 2818 consensus_queue.cc:1048] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20251215 20:52:46.360069 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.357967 2853 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:46.314388 2919 consensus_queue.cc:1048] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20251215 20:52:46.361276 1721 raft_consensus.cc:1240] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:46.360805 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.522430 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:46.518297 1794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 684) took 1028 ms. Trace:
I20251215 20:52:46.583040 1794 rpcz_store.cc:276] 1215 20:52:45.490147 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.490272 (+ 125us) service_pool.cc:225] Handling call
1215 20:52:45.507845 (+ 17573us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:45.963295 (+455450us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:46.518003 (+554708us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400275954. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:46.518223 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":564636928}
W20251215 20:52:46.484174 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:46.585146 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:46.585613 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.357339 1787 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.581990 1789 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:46.460850 2897 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:46.581914 1640 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:46.523608 1791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46054 (request call id 679) took 1034 ms. Trace:
I20251215 20:52:46.596915 1791 rpcz_store.cc:276] 1215 20:52:45.488699 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.489341 (+ 642us) service_pool.cc:225] Handling call
1215 20:52:46.523336 (+1033995us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54000c9c54. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:46.523528 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1849791360}
I20251215 20:52:46.328081 2868 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:46.328953 2718 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:46.325171 2869 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.523648 1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 816) took 1103 ms. Trace:
W20251215 20:52:46.633822 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:46.461990 2256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.641184 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.517453 2850 raft_consensus.cc:3055] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:46.579512 2808 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:46.645118 2808 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.356899 2775 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.571097 2874 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.653939 2775 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:46.635895 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 234713us
W20251215 20:52:46.507705 2737 consensus_meta.cc:287] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 1.035s user 0.007s sys 0.000s
I20251215 20:52:46.662398 1760 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:46.640077 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.331218 2784 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.331363 2889 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.667889 2868 consensus_queue.cc:1048] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20251215 20:52:46.668855 2829 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:46.670568 2868 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:46.670431 2829 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:46.671196 2868 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.346071 2859 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.576185 2772 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.641184 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:46.674124 1786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 681) took 1184 ms. Trace:
I20251215 20:52:46.674458 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:46.511111 2765 consensus_meta.cc:287] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 1.081s user 0.008s sys 0.000s
W20251215 20:52:46.450834 2895 log.cc:927] Time spent T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
I20251215 20:52:46.349175 2872 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:46.674563 1786 rpcz_store.cc:276] 1215 20:52:45.489260 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.493553 (+ 4293us) service_pool.cc:225] Handling call
1215 20:52:46.029999 (+536446us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b5800002a98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:46.030227 (+ 228us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:46.138354 (+108127us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.149408 (+ 11054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:46.193886 (+ 44478us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:46.201096 (+ 7210us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:46.673866 (+472770us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b54001bfdd4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:46.673922 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:46.674049 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":209561728}
I20251215 20:52:46.675496 2872 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.451316 2907 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:46.357533 2736 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.678722 2736 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:46.451085 2915 log.cc:927] Time spent T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.116s user 0.001s sys 0.000s
W20251215 20:52:46.363108 2832 consensus_meta.cc:287] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 1.021s user 0.011s sys 0.001s
I20251215 20:52:46.513815 2861 raft_consensus.cc:3055] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:46.645550 2921 raft_consensus.cc:2955] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:46.656816 2720 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.345806 2809 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:46.331297 2636 consensus_queue.cc:1048] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.304s
I20251215 20:52:46.638613 1646 rpcz_store.cc:276] 1215 20:52:45.420379 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.495655 (+ 75276us) service_pool.cc:225] Handling call
1215 20:52:46.522841 (+1027186us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b5800004298. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:46.523077 (+ 236us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:46.523287 (+ 210us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.523315 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:46.523361 (+ 46us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:46.523392 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:46.523454 (+ 62us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:46.523579 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8456064}
I20251215 20:52:46.328997 2257 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:46.657913 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:46.707755 1793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s user 0.008s sys 0.043s
I20251215 20:52:46.604439 2853 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.361095 2916 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.453282 1638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:46.603556 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.507874 1642 raft_consensus.cc:2468] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:46.667348 2737 raft_consensus.cc:2749] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:46.721130 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:46.722075 1646 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:46.522873 2833 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.668654 2718 raft_consensus.cc:2804] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:46.655750 2722 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.588217 2866 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:46.587680 2647 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.672664 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:46.672772 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.735327 1721 raft_consensus.cc:2393] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:46.516194 2807 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.644280 2850 raft_consensus.cc:740] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
W20251215 20:52:46.733800 2926 log.cc:927] Time spent T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.218s user 0.007s sys 0.005s
I20251215 20:52:46.361346 2806 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.683254 1789 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:46.725509 2907 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:46.689203 1788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 688) took 1193 ms. Trace:
I20251215 20:52:46.708025 1791 raft_consensus.cc:2393] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:46.741726 1788 rpcz_store.cc:276] 1215 20:52:45.496213 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.740500 (+244287us) service_pool.cc:225] Handling call
1215 20:52:45.767393 (+ 26893us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:45.767631 (+ 238us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:45.767673 (+ 42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:45.771370 (+ 3697us) log.cc:844] Serialized 26 byte log entry
1215 20:52:45.843875 (+ 72505us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:45.843917 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:45.843984 (+ 67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:46.688953 (+844969us) raft_consensus.cc:1685] finished
1215 20:52:46.688987 (+ 34us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:46.689137 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":70001,"threads_started":1,"wal-append.queue_time_us":298137}
I20251215 20:52:46.742879 2807 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.728255 2718 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:46.743803 2718 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.730721 1786 raft_consensus.cc:1240] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: []
W20251215 20:52:46.717016 1793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s user 0.008s sys 0.043s
I20251215 20:52:46.682513 2918 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:46.684669 2861 raft_consensus.cc:740] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:46.704247 2852 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.728284 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.752277 1718 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:46.729315 1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 681) took 1258 ms. Trace:
W20251215 20:52:46.719823 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 391025us
I20251215 20:52:46.682674 2765 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.731882 1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43800 (request call id 820) took 1262 ms. Trace:
W20251215 20:52:46.741122 1789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46054 (request call id 685) took 1250 ms (client timeout 1612 ms). Trace:
W20251215 20:52:46.758788 1789 rpcz_store.cc:269] 1215 20:52:45.490394 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.561210 (+ 70816us) service_pool.cc:225] Handling call
1215 20:52:46.522247 (+961037us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b5800002a98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:46.741060 (+218813us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12420352}
I20251215 20:52:46.686985 2832 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.452831 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:46.709736 1761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s user 0.016s sys 0.025s
W20251215 20:52:46.766103 1761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s user 0.016s sys 0.025s
I20251215 20:52:46.768050 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.769066 1718 raft_consensus.cc:2393] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:46.749879 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.753593 1716 rpcz_store.cc:276] 1215 20:52:45.465806 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.479642 (+ 13836us) service_pool.cc:225] Handling call
1215 20:52:46.714336 (+1234694us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400112e54. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:46.724453 (+ 10117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1236887808}
I20251215 20:52:46.740058 2850 consensus_queue.cc:260] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.737655 2897 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:46.741583 2907 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:52:46.760224 2638 consensus_meta.cc:287] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.559s user 0.009s sys 0.001s
I20251215 20:52:46.769389 1712 raft_consensus.cc:2368] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:46.782923 1720 raft_consensus.cc:2368] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:46.785751 2876 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:46.786512 2876 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:46.780222 2907 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:46.803390 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.812873 2850 raft_consensus.cc:3060] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:46.814242 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.817389 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.779500 1786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 691) took 1275 ms. Trace:
I20251215 20:52:46.824677 1717 raft_consensus.cc:2468] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:46.835446 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.782832 2833 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.762915 1642 rpcz_store.cc:276] 1215 20:52:45.462543 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.481522 (+ 18979us) service_pool.cc:225] Handling call
1215 20:52:46.724821 (+1243299us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:46.852387 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.852627 2876 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:46.820623 2829 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:46.853371 1716 raft_consensus.cc:2393] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:46.841598 1721 raft_consensus.cc:2368] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3.
I20251215 20:52:46.854423 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.854522 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.855284 1716 raft_consensus.cc:2393] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:46.770596 2818 consensus_queue.cc:1059] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20251215 20:52:46.856277 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.863653 1716 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:46.839239 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.785192 2638 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:46.913388 1718 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:46.862785 1721 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:46.826716 1646 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:46.780107 2897 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:46.774238 2918 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:46.956787 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:46.911554 1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s user 0.019s sys 0.012s
W20251215 20:52:46.959779 1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s user 0.020s sys 0.012s
W20251215 20:52:46.960238 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:46.964316 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:46.972656 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.973713 1721 raft_consensus.cc:2393] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:46.802410 2861 consensus_queue.cc:260] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:46.886382 2868 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:47.006223 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:46.873462 2876 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:47.007081 1718 raft_consensus.cc:2393] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:47.007169 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:46.948220 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:47.007802 1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s user 0.020s sys 0.055s
W20251215 20:52:46.971748 2679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s user 0.042s sys 0.046s
I20251215 20:52:47.010948 1716 raft_consensus.cc:2393] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:47.018481 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.019384 1721 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
W20251215 20:52:47.014081 1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s user 0.021s sys 0.056s
W20251215 20:52:47.015940 1761 leader_election.cc:336] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.522s (SENT)
I20251215 20:52:46.976994 2852 raft_consensus.cc:3055] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:46.833413 1786 rpcz_store.cc:276] 1215 20:52:45.501874 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.676222 (+1174348us) service_pool.cc:225] Handling call
1215 20:52:46.709969 (+ 33747us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:46.755524 (+ 45555us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:46.776979 (+ 21455us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:47.022586 1761 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:47.013139 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.026777 1717 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
W20251215 20:52:47.023721 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 726755us
W20251215 20:52:47.027412 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:47.018191 2679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s user 0.042s sys 0.046s
I20251215 20:52:46.981878 2809 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:47.033644 1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s user 0.041s sys 0.037s
W20251215 20:52:47.034106 1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s user 0.042s sys 0.037s
I20251215 20:52:47.029945 1612 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:47.030872 2775 consensus_queue.cc:1059] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:47.037086 2775 raft_consensus.cc:3055] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:47.037460 2775 raft_consensus.cc:740] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:47.038295 2775 consensus_queue.cc:260] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:47.039602 2775 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:47.040479 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:47.040943 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.032106 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:47.042505 1721 raft_consensus.cc:2368] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 3. Current term is 4.
I20251215 20:52:47.043586 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.044384 1721 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:47.048367 2638 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:47.049316 1786 raft_consensus.cc:1275] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:47.049572 1721 raft_consensus.cc:1240] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20251215 20:52:47.051643 2922 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:47.051985 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.052711 1716 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:47.010658 2722 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:47.009796 2853 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:47.016857 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:47.052745 2736 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
W20251215 20:52:47.061231 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.061249 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.057330 1716 raft_consensus.cc:1240] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 3. Current term is 4. Ops: []
I20251215 20:52:47.079879 2924 consensus_queue.cc:1059] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20251215 20:52:47.047984 1715 raft_consensus.cc:2468] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:47.011999 2928 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:47.090022 1717 raft_consensus.cc:1240] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 3. Ops: []
W20251215 20:52:47.082504 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 66591.3us
W20251215 20:52:47.091339 1761 leader_election.cc:336] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.539s (SENT)
I20251215 20:52:47.085330 1721 raft_consensus.cc:1240] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:47.053567 2256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.094468 1642 raft_consensus.cc:2410] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20251215 20:52:47.096256 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:47.049963 2806 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:47.091760 1761 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:47.053761 1612 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:47.023389 2852 raft_consensus.cc:740] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:47.051680 1786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 696) took 1307 ms. Trace:
I20251215 20:52:47.076833 2765 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:47.082474 1718 raft_consensus.cc:2368] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3.
I20251215 20:52:47.086966 1713 raft_consensus.cc:2468] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:47.087703 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:47.018124 2876 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:47.078830 2638 raft_consensus.cc:2749] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:47.104053 1761 leader_election.cc:336] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.540s (SENT)
W20251215 20:52:47.169914 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 65893.2us
W20251215 20:52:47.104671 2256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.049623 2832 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:47.052327 2922 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:47.105106 2852 consensus_queue.cc:260] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:47.122347 2868 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:47.083032 2866 consensus_queue.cc:1059] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20251215 20:52:47.126673 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.139456 1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 994) took 1094 ms. Trace:
W20251215 20:52:47.140455 1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 669) took 1725 ms (client timeout 1612 ms). Trace:
I20251215 20:52:47.187672 2922 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:47.106442 1786 rpcz_store.cc:276] 1215 20:52:45.744273 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:47.048479 (+1304206us) service_pool.cc:225] Handling call
1215 20:52:47.048928 (+ 449us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:47.049750 (+ 822us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:47.051613 (+ 1863us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:47.188851 1715 raft_consensus.cc:2468] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:47.189132 1786 raft_consensus.cc:1240] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:47.189829 1786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 697) took 1435 ms. Trace:
I20251215 20:52:47.190048 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:47.190253 1786 rpcz_store.cc:276] 1215 20:52:45.754595 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:47.188575 (+1433980us) service_pool.cc:225] Handling call
1215 20:52:47.188921 (+ 346us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:47.189573 (+ 652us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:47.189767 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:47.102018 2872 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:47.191308 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:47.144162 1760 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:47.145948 2918 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:47.146482 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.188012 1643 rpcz_store.cc:276] 1215 20:52:46.044671 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.304738 (+260067us) service_pool.cc:225] Handling call
1215 20:52:46.666635 (+361897us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b5800004298. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:46.666879 (+ 244us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:46.688854 (+ 21975us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.707228 (+ 18374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:46.709171 (+ 1943us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:46.715706 (+ 6535us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:47.139137 (+423431us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b540005c3d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:47.139194 (+ 57us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:47.139375 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":42032768}
I20251215 20:52:47.147158 2897 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:47.194438 2897 raft_consensus.cc:2804] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:47.194921 2897 raft_consensus.cc:697] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:47.195755 2897 consensus_queue.cc:237] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:47.150698 2861 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:47.176126 2876 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:47.153328 1712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 670) took 1738 ms (client timeout 1730 ms). Trace:
W20251215 20:52:47.188095 1720 rpcz_store.cc:269] 1215 20:52:45.414856 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.421395 (+ 6539us) service_pool.cc:225] Handling call
1215 20:52:47.140172 (+1718777us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540012b954. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:47.140375 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2974098176}
I20251215 20:52:47.203037 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.203922 1720 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:47.185273 2808 consensus_meta.cc:287] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.537s user 0.011s sys 0.000s
I20251215 20:52:47.204888 2808 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:47.136978 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.148779 2760 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:47.201454 1712 rpcz_store.cc:269] 1215 20:52:45.415215 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.423492 (+ 8277us) service_pool.cc:225] Handling call
1215 20:52:47.152993 (+1729501us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400292cd4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:47.153209 (+ 216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2679005056}
I20251215 20:52:47.207787 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:47.208494 1712 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:47.210263 1715 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:47.093719 2736 raft_consensus.cc:697] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:47.098781 2928 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:47.184790 2852 raft_consensus.cc:3060] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:47.239421 2636 raft_consensus.cc:1064] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:47.143811 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:47.240212 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:47.240602 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.239868 2866 raft_consensus.cc:3055] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
W20251215 20:52:47.239868 2636 raft_consensus.cc:1068] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
I20251215 20:52:47.241303 2866 raft_consensus.cc:740] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
W20251215 20:52:47.212282 1787 consensus_meta.cc:287] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.576s user 0.009s sys 0.000s
W20251215 20:52:47.192647 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 48591.5us
I20251215 20:52:47.216570 1720 raft_consensus.cc:1275] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:47.242211 2866 consensus_queue.cc:260] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:47.243242 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:47.243397 2866 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:47.242231 1760 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:47.245929 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.218412 1721 raft_consensus.cc:2368] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3.
I20251215 20:52:47.206430 1717 raft_consensus.cc:1240] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:47.247856 1720 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:47.204082 2872 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:47.219894 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 166223us
W20251215 20:52:47.220589 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.225572 2853 raft_consensus.cc:3055] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:47.226166 2874 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:52:47.259644 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 82179.1us
I20251215 20:52:47.231664 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:47.238708 1609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 93818.3us
I20251215 20:52:47.274334 1718 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:47.277644 1721 raft_consensus.cc:1275] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:47.275875 2928 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:47.259171 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:47.279424 2736 consensus_queue.cc:237] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:47.281667 1713 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:47.285506 1761 leader_election.cc:336] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.597s (SENT)
W20251215 20:52:47.286638 1761 leader_election.cc:336] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.608s (SENT)
I20251215 20:52:47.286825 1717 raft_consensus.cc:1240] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:47.287262 1761 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:47.287550 1720 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
W20251215 20:52:47.291895 1761 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.645s (SENT)
I20251215 20:52:47.254204 2638 raft_consensus.cc:2804] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election won for term 4
W20251215 20:52:47.294302 1761 leader_election.cc:336] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.668s (SENT)
I20251215 20:52:47.294749 1761 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:47.295737 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:47.295802 1761 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.693s (SENT)
I20251215 20:52:47.296492 1761 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:47.297293 1644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s user 0.035s sys 0.027s
W20251215 20:52:47.298324 1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s user 0.035s sys 0.027s
I20251215 20:52:47.258905 2853 raft_consensus.cc:740] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:47.300036 1612 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:47.247259 1787 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
W20251215 20:52:47.304852 1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.020s user 0.018s sys 0.046s
I20251215 20:52:47.304169 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:47.306118 1646 raft_consensus.cc:2393] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
W20251215 20:52:47.305266 1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.023s user 0.018s sys 0.046s
W20251215 20:52:47.308959 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 1.03163e+06us
W20251215 20:52:47.301214 1761 leader_election.cc:336] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.693s (SENT)
W20251215 20:52:47.300223 2718 consensus_meta.cc:287] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.556s user 0.010s sys 0.000s
I20251215 20:52:47.315055 1761 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:47.324681 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:47.321818 1612 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:47.326660 1612 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:47.307469 2924 raft_consensus.cc:2804] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:47.314442 1787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46054 (request call id 701) took 1182 ms. Trace:
I20251215 20:52:47.336969 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:47.339388 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.303757 2874 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20251215 20:52:47.337028 2876 raft_consensus.cc:2749] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:47.336074 2924 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:47.327064 2922 consensus_queue.cc:1059] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20251215 20:52:47.328640 2718 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:47.388986 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:47.382901 2832 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:47.392642 2775 raft_consensus.cc:2804] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:47.394279 2808 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:47.404042 1646 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:47.384500 2907 consensus_meta.cc:287] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Time spent flushing consensus metadata: real 0.583s user 0.005s sys 0.005s
I20251215 20:52:47.407277 1712 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:47.403296 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:47.364599 2861 consensus_queue.cc:1059] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20251215 20:52:47.336525 2853 consensus_queue.cc:260] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:47.522141 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.914458 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:47.916105 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:47.422662 2916 consensus_meta.cc:287] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.696s user 0.012s sys 0.000s
I20251215 20:52:47.917325 2916 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:47.918386 1715 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:47.919796 2916 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:47.547963 1719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.222s user 0.016s sys 0.049s
W20251215 20:52:47.786927 2912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.591s user 0.020s sys 0.038s
I20251215 20:52:47.463225 2832 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:47.648434 1641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.069s user 0.008s sys 0.042s
W20251215 20:52:47.668337 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:47.783233 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.990203 1646 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
W20251215 20:52:48.002777 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.002940 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.002183 1641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.430s user 0.009s sys 0.060s
W20251215 20:52:47.786979 1645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.460s user 0.005s sys 0.057s
W20251215 20:52:48.004134 1645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.681s user 0.007s sys 0.059s
I20251215 20:52:48.004938 1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 829) took 1978 ms. Trace:
I20251215 20:52:48.005330 1645 rpcz_store.cc:276] 1215 20:52:46.026546 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.039054 (+ 12508us) service_pool.cc:225] Handling call
1215 20:52:46.039486 (+ 432us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:46.039681 (+ 195us) raft_consensus.cc:1534] Early marking committed up to index 2
1215 20:52:46.320116 (+280435us) log.cc:844] Serialized 14 byte log entry
1215 20:52:48.004527 (+1684411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:48.004597 (+ 70us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:48.004647 (+ 50us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.004726 (+ 79us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.004874 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1731,"prepare.queue_time_us":603702,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":332162,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":1961415,"threads_started":2}
W20251215 20:52:47.578864 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:47.868696 1718 consensus_meta.cc:287] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.590s user 0.003s sys 0.005s
I20251215 20:52:48.008067 1718 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:48.009138 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.009727 1718 raft_consensus.cc:2376] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
W20251215 20:52:48.010809 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.577294 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:47.932458 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.011412 1720 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:47.392534 2874 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:47.390234 2806 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:47.340512 1787 rpcz_store.cc:276] 1215 20:52:46.132147 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.202383 (+ 70236us) service_pool.cc:225] Handling call
1215 20:52:47.308333 (+1105950us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:47.634465 2778 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.310s user 0.024s sys 0.046s
I20251215 20:52:47.864698 2850 raft_consensus.cc:1064] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:47.411568 2647 consensus_meta.cc:287] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Time spent flushing consensus metadata: real 0.665s user 0.010s sys 0.001s
W20251215 20:52:47.862536 2931 log.cc:927] Time spent T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.108s user 0.001s sys 0.000s
W20251215 20:52:47.867901 2852 consensus_meta.cc:287] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.629s user 0.006s sys 0.002s
W20251215 20:52:47.880106 1713 consensus_meta.cc:287] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.598s user 0.006s sys 0.000s
W20251215 20:52:47.892383 2866 consensus_meta.cc:287] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.649s user 0.007s sys 0.003s
I20251215 20:52:47.395960 2924 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:47.921072 2775 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:47.946918 2737 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:52:47.841467 1637 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.168s user 0.010s sys 0.041s
I20251215 20:52:47.403563 2765 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:47.917732 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:47.741734 2936 raft_consensus.cc:3055] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:47.863634 2922 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:47.877065 2718 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:47.423928 2760 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:47.557749 2833 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:47.740974 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:47.942351 2907 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:47.544219 2872 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:47.574510 2722 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:47.969795 1719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.646s user 0.029s sys 0.058s
W20251215 20:52:47.786751 1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.548s user 0.016s sys 0.041s
I20251215 20:52:47.953428 2853 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:47.741951 2626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.085s user 0.035s sys 0.035s
I20251215 20:52:48.003443 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:47.730300 1721 raft_consensus.cc:1275] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 20:52:48.011507 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:47.643330 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:48.172273 1717 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:48.012977 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.003386 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.174731 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.014081 1686 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:47.967600 2808 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:48.024516 1795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.445s user 0.041s sys 0.040s
W20251215 20:52:48.178122 1795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.599s user 0.041s sys 0.040s
W20251215 20:52:48.028523 1792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.680s user 0.029s sys 0.034s
W20251215 20:52:48.178869 1792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.830s user 0.029s sys 0.034s
W20251215 20:52:47.988982 2912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.835s user 0.022s sys 0.040s
I20251215 20:52:48.058938 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.063496 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:48.067402 1720 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:48.183144 1645 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:48.183809 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.018558 2874 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:48.013940 2818 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
W20251215 20:52:48.061976 2925 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.381s user 0.005s sys 0.029s
I20251215 20:52:48.092397 2737 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
W20251215 20:52:48.088682 1637 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.585s user 0.010s sys 0.042s
I20251215 20:52:48.088853 2775 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:48.064308 2850 raft_consensus.cc:1068] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
W20251215 20:52:48.099119 1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.861s user 0.016s sys 0.046s
I20251215 20:52:48.100104 2760 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:48.136700 1646 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:48.078756 1713 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:48.058640 2806 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:48.102661 2626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.446s user 0.037s sys 0.045s
I20251215 20:52:48.090703 2936 raft_consensus.cc:740] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:48.102349 1643 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:48.138437 1790 raft_consensus.cc:2410] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20251215 20:52:48.175781 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 161796us
I20251215 20:52:48.188838 2932 raft_consensus.cc:2749] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:48.184487 1720 raft_consensus.cc:2376] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
W20251215 20:52:48.057890 2778 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.735s user 0.026s sys 0.062s
I20251215 20:52:48.183152 1718 raft_consensus.cc:2376] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
W20251215 20:52:48.109253 2863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.603s user 0.027s sys 0.058s
I20251215 20:52:48.101090 2833 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.102569 2872 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:48.102520 2722 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.101501 2765 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.206382 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:48.275786 2921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.107s user 0.004s sys 0.016s
I20251215 20:52:48.101620 2922 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:48.254004 1793 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.419s user 0.016s sys 0.022s
I20251215 20:52:48.184686 2923 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:48.179350 2928 raft_consensus.cc:2749] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:52:48.256147 1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.256843 1645 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
W20251215 20:52:48.362556 1791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.582s user 0.032s sys 0.052s
W20251215 20:52:48.362847 1791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.582s user 0.032s sys 0.052s
W20251215 20:52:48.186712 2860 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.675s user 0.029s sys 0.047s
W20251215 20:52:48.263515 2258 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.449s user 0.028s sys 0.019s
I20251215 20:52:48.279973 2735 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:48.188995 2874 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:48.253769 2925 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.508s user 0.005s sys 0.030s
W20251215 20:52:48.274871 1639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.444s user 0.024s sys 0.052s
W20251215 20:52:48.371373 1639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.550s user 0.024s sys 0.052s
I20251215 20:52:48.275650 1686 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:48.372385 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 96808us
I20251215 20:52:48.374337 1686 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:48.183514 2808 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.376556 2935 raft_consensus.cc:2764] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20251215 20:52:48.377418 2935 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:48.377962 2935 raft_consensus.cc:697] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:48.379026 2935 consensus_queue.cc:237] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:48.380940 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.381419 2937 log.cc:927] Time spent T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.240s user 0.000s sys 0.000s
I20251215 20:52:48.382714 2808 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.383641 1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 819) took 2941 ms. Trace:
I20251215 20:52:48.384047 1644 rpcz_store.cc:276] 1215 20:52:45.442157 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.045780 (+603623us) service_pool.cc:225] Handling call
1215 20:52:46.075657 (+ 29877us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.098160 (+ 22503us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.098200 (+ 40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.098714 (+ 514us) log.cc:844] Serialized 26 byte log entry
1215 20:52:47.298729 (+1200015us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:47.298778 (+ 49us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:47.298853 (+ 75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.383367 (+1084514us) raft_consensus.cc:1685] finished
1215 20:52:48.383391 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.383546 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":47562,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":984816,"threads_started":1,"wal-append.queue_time_us":1923750}
I20251215 20:52:48.386111 1644 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:48.387568 1712 raft_consensus.cc:2393] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:48.387888 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.389180 2833 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.365656 2679 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:48.392761 1790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46054 (request call id 694) took 2813 ms (client timeout 1854 ms). Trace:
W20251215 20:52:48.393245 1790 rpcz_store.cc:269] 1215 20:52:45.579056 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.781896 (+202840us) service_pool.cc:225] Handling call
1215 20:52:48.392545 (+2610649us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b540019ee54. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:48.392686 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4711281536}
I20251215 20:52:48.361726 2936 consensus_queue.cc:260] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.394863 2936 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:48.395151 1790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38896 (request call id 74) took 2367 ms. Trace:
I20251215 20:52:48.397809 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.398944 1712 raft_consensus.cc:2393] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:48.196889 2818 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:48.401692 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.358235 2940 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:48.273697 2898 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.540s user 0.039s sys 0.096s
I20251215 20:52:48.280623 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:48.227797 1788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.399s user 0.003s sys 0.056s
W20251215 20:52:48.403117 2898 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.672s user 0.039s sys 0.096s
W20251215 20:52:48.403400 1788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.574s user 0.003s sys 0.058s
I20251215 20:52:48.369611 2968 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:48.267138 1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 775) took 1139 ms. Trace:
I20251215 20:52:48.404199 1713 rpcz_store.cc:276] 1215 20:52:47.127372 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:47.231218 (+103846us) service_pool.cc:225] Handling call
1215 20:52:48.264634 (+1033416us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.404836 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:48.405046 2918 raft_consensus.cc:2749] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:48.402468 1712 raft_consensus.cc:2468] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:48.405597 1795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 690) took 2904 ms. Trace:
I20251215 20:52:48.406493 1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1008) took 1087 ms. Trace:
I20251215 20:52:48.406968 1646 rpcz_store.cc:276] 1215 20:52:47.319354 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.264735 (+945381us) service_pool.cc:225] Handling call
1215 20:52:48.406434 (+141699us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.406033 1795 rpcz_store.cc:276] 1215 20:52:45.501613 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.318364 (+816751us) service_pool.cc:225] Handling call
1215 20:52:46.329617 (+ 11253us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.578516 (+248899us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.578550 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.579134 (+ 584us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.178565 (+1599431us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.178610 (+ 45us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.178683 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.405368 (+226685us) raft_consensus.cc:1685] finished
1215 20:52:48.405388 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.405538 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":284305,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":12208,"thread_start_us":1599005,"threads_started":1,"wal-append.queue_time_us":1744386}
I20251215 20:52:48.408134 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:48.408900 1646 raft_consensus.cc:2393] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 2: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:48.408998 1792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 689) took 2907 ms. Trace:
W20251215 20:52:48.275928 1794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.521s user 0.009s sys 0.011s
W20251215 20:52:48.415951 1794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.661s user 0.009s sys 0.011s
I20251215 20:52:48.409407 1792 rpcz_store.cc:276] 1215 20:52:45.501280 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.228231 (+726951us) service_pool.cc:225] Handling call
1215 20:52:46.228594 (+ 363us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.230810 (+ 2216us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.230849 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.307234 (+ 76385us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.187326 (+1880092us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.187372 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.187457 (+ 85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.408782 (+221325us) raft_consensus.cc:1685] finished
1215 20:52:48.408805 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.408942 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1790,"raft.queue_time_us":2110,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":21514,"thread_start_us":1830715,"threads_started":1,"wal-append.queue_time_us":2082611}
I20251215 20:52:48.416848 1794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 692) took 2910 ms. Trace:
I20251215 20:52:48.417207 1794 rpcz_store.cc:276] 1215 20:52:45.506221 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.682119 (+1175898us) service_pool.cc:225] Handling call
1215 20:52:46.714964 (+ 32845us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b5800002a98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:46.715197 (+ 233us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.727029 (+ 11832us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.727061 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.730598 (+ 3537us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.416423 (+1685825us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.416462 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.416526 (+ 64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.416571 (+ 45us) raft_consensus.cc:1685] finished
1215 20:52:48.416583 (+ 12us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.416792 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8485,"raft.queue_time_us":554,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":16997,"spinlock_wait_cycles":7878016,"thread_start_us":1661680,"threads_started":1,"wal-append.queue_time_us":1636392}
I20251215 20:52:48.408902 1795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38896 (request call id 75) took 2370 ms. Trace:
I20251215 20:52:48.420737 1795 rpcz_store.cc:276] 1215 20:52:46.038156 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.408006 (+2369850us) service_pool.cc:225] Handling call
1215 20:52:48.408391 (+ 385us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:48.408575 (+ 184us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:48.408602 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:48.408645 (+ 43us) raft_consensus.cc:1645] Marking committed up to 5
1215 20:52:48.408676 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.408732 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.408846 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.409624 1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1011) took 1061 ms. Trace:
I20251215 20:52:48.422032 1646 rpcz_store.cc:276] 1215 20:52:47.347987 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.407875 (+1059888us) service_pool.cc:225] Handling call
1215 20:52:48.409324 (+ 1449us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:48.275460 1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.948s user 0.003s sys 0.017s
I20251215 20:52:48.329535 1721 raft_consensus.cc:2393] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:48.423040 1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.096s user 0.005s sys 0.018s
W20251215 20:52:48.301028 2863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.795s user 0.027s sys 0.065s
I20251215 20:52:48.353613 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:48.273922 1638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.132s user 0.017s sys 0.023s
I20251215 20:52:48.357288 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:48.367887 2860 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.854s user 0.029s sys 0.047s
W20251215 20:52:48.306674 2636 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s user 0.006s sys 0.014s
W20251215 20:52:48.358531 1793 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.593s user 0.017s sys 0.022s
I20251215 20:52:48.406708 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.258873 1717 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
W20251215 20:52:48.278295 2897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.058s user 0.005s sys 0.016s
W20251215 20:52:48.429864 2636 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s user 0.007s sys 0.015s
W20251215 20:52:48.278144 1595 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.826s user 0.010s sys 0.025s
W20251215 20:52:48.366328 2258 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.552s user 0.028s sys 0.020s
W20251215 20:52:48.433952 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 1.62772e+06us
I20251215 20:52:48.190773 1787 raft_consensus.cc:1275] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 20:52:48.359143 2921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s user 0.005s sys 0.017s
I20251215 20:52:48.356451 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
W20251215 20:52:48.362304 2913 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.787s user 0.007s sys 0.056s
I20251215 20:52:48.392773 2679 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.399667 1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59670 (request call id 64) took 3012 ms. Trace:
W20251215 20:52:48.433668 1595 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.982s user 0.015s sys 0.026s
W20251215 20:52:48.423363 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 1.0966e+06us
I20251215 20:52:48.446777 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:48.424882 1789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.596s user 0.010s sys 0.053s
I20251215 20:52:48.450048 1795 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
W20251215 20:52:48.450235 1789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.621s user 0.010s sys 0.053s
I20251215 20:52:48.403996 2968 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:48.446588 1641 rpcz_store.cc:276] 1215 20:52:45.387750 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.481452 (+ 93702us) service_pool.cc:225] Handling call
1215 20:52:45.501630 (+ 20178us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:45.508890 (+ 7260us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:45.508929 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:45.573733 (+ 64804us) log.cc:844] Serialized 26 byte log entry
1215 20:52:46.572202 (+998469us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b18000a3420. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30c3a9ef21 00007f30c3aab901 00007f30bac2f977 00007f30c3a177e9 00007f30bac4c28b 00007f30bac4a52f 00007f30bac4c7f2 00007f30bd8945ab 00007f30bd89a0c3 00007f30bd89a471 00007f30bdcb673f
1215 20:52:48.007458 (+1435256us) raft_consensus.cc:1645] Marking committed up to 4
1215 20:52:48.007507 (+ 49us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.007686 (+ 179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.399294 (+391608us) raft_consensus.cc:1685] finished
1215 20:52:48.399325 (+ 31us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.399596 (+ 271us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":170,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":72561,"spinlock_wait_cycles":42160384,"thread_start_us":1435047,"threads_started":1,"wal-append.queue_time_us":2730136}
I20251215 20:52:48.362905 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:48.454558 1645 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:48.446265 2913 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.872s user 0.007s sys 0.056s
I20251215 20:52:48.432727 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:48.431574 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.437469 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:48.461158 1720 raft_consensus.cc:3060] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:48.367635 2923 raft_consensus.cc:697] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:48.437386 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.440439 1792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38896 (request call id 76) took 1758 ms. Trace:
I20251215 20:52:48.455291 1712 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:48.468958 1721 raft_consensus.cc:2368] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3.
I20251215 20:52:48.441882 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.469592 1718 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
W20251215 20:52:48.431607 2938 log.cc:927] Time spent T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.071s user 0.000s sys 0.001s
I20251215 20:52:48.443708 1794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:46036 (request call id 551) took 2294 ms. Trace:
I20251215 20:52:48.477403 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:48.402503 2940 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:48.277776 1786 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.027s user 0.019s sys 0.023s
I20251215 20:52:48.425691 2320 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
W20251215 20:52:48.428057 1642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.200s user 0.013s sys 0.014s
I20251215 20:52:48.395539 1790 rpcz_store.cc:276] 1215 20:52:46.028077 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.394205 (+2366128us) service_pool.cc:225] Handling call
1215 20:52:48.394568 (+ 363us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:48.394770 (+ 202us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:48.394800 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:48.394845 (+ 45us) raft_consensus.cc:1645] Marking committed up to 5
1215 20:52:48.394881 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.394957 (+ 76us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.395092 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.363493 2832 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.482656 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.447279 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.462596 1646 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:48.463086 1761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s user 0.010s sys 0.019s
I20251215 20:52:48.465049 1792 rpcz_store.cc:276] 1215 20:52:46.681684 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.429110 (+1747426us) service_pool.cc:225] Handling call
1215 20:52:48.439835 (+ 10725us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:48.440035 (+ 200us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:48.440062 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:48.440106 (+ 44us) raft_consensus.cc:1645] Marking committed up to 5
1215 20:52:48.440137 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.440192 (+ 55us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.440367 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:48.427731 1638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.286s user 0.018s sys 0.024s
I20251215 20:52:48.430634 2735 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.447655 1714 raft_consensus.cc:1240] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:48.448190 2319 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:48.431042 2897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.213s user 0.005s sys 0.022s
W20251215 20:52:48.499486 2257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s user 0.022s sys 0.111s
W20251215 20:52:48.499946 2257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s user 0.022s sys 0.111s
W20251215 20:52:48.479341 1640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.594s user 0.024s sys 0.032s
W20251215 20:52:48.500909 1640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.616s user 0.024s sys 0.032s
W20251215 20:52:48.502162 1760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.195s user 0.013s sys 0.022s
W20251215 20:52:48.502499 1760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.196s user 0.013s sys 0.022s
W20251215 20:52:48.502745 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 1.20089e+06us
I20251215 20:52:48.474434 1645 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
W20251215 20:52:48.452521 2919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.045s user 0.016s sys 0.013s
I20251215 20:52:48.468279 2760 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.477403 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.478560 1641 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:48.507987 1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1012) took 1140 ms. Trace:
I20251215 20:52:48.508256 1641 rpcz_store.cc:276] 1215 20:52:47.367748 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.456198 (+1088450us) service_pool.cc:225] Handling call
1215 20:52:48.507935 (+ 51737us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.510713 1686 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:48.463287 2638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.128s user 0.008s sys 0.021s
W20251215 20:52:48.462956 2736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.179s user 0.007s sys 0.024s
I20251215 20:52:48.483428 1717 raft_consensus.cc:2393] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:48.506225 2818 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:48.459405 1612 leader_election.cc:400] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:48.575606 1612 leader_election.cc:403] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20251215 20:52:48.576092 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 126385us
I20251215 20:52:48.576901 1612 leader_election.cc:400] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:48.577190 1612 leader_election.cc:403] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20251215 20:52:48.492113 1761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.168s user 0.010s sys 0.019s
I20251215 20:52:48.492775 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.580178 1646 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:48.477803 1794 rpcz_store.cc:276] 1215 20:52:46.140655 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.419096 (+2278441us) service_pool.cc:225] Handling call
1215 20:52:48.435160 (+ 16064us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.580741 1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1009) took 1254 ms. Trace:
I20251215 20:52:48.581039 1646 rpcz_store.cc:276] 1215 20:52:47.326841 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.422795 (+1095954us) service_pool.cc:225] Handling call
1215 20:52:48.580687 (+157892us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.456310 1787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 698) took 2692 ms. Trace:
I20251215 20:52:48.458319 2907 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.503847 1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1015) took 1116 ms. Trace:
I20251215 20:52:48.581861 1645 rpcz_store.cc:276] 1215 20:52:47.387907 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.362633 (+974726us) service_pool.cc:225] Handling call
1215 20:52:48.503792 (+141159us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:48.479655 1786 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.234s user 0.020s sys 0.023s
W20251215 20:52:48.491287 1642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.264s user 0.014s sys 0.014s
I20251215 20:52:48.512454 2872 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:48.495826 2806 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:48.529680 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.589535 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.590062 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.546118 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.548151 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:48.591107 1758 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.106.132:44997 timed out after 1.538s (SENT) [suppressed 59 similar messages]
W20251215 20:52:48.549964 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.562261 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:48.489091 1720 raft_consensus.cc:2468] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:48.505548 2922 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:48.591931 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.574962 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 688) took 2664 ms. Trace:
W20251215 20:52:48.592628 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.592578 1719 rpcz_store.cc:276] 1215 20:52:45.910418 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.013493 (+103075us) service_pool.cc:225] Handling call
1215 20:52:46.013864 (+ 371us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.130550 (+116686us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.130583 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.303562 (+172979us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.098783 (+1795221us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.098826 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.098906 (+ 80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.574708 (+475802us) raft_consensus.cc:1685] finished
1215 20:52:48.574728 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.574873 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":21576,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":1891022,"threads_started":2,"wal-append.queue_time_us":1962672}
W20251215 20:52:48.512171 2919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s user 0.016s sys 0.013s
W20251215 20:52:48.591143 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.562220 2315 pending_rounds.cc:85] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Aborting all ops after (but not including) 2
I20251215 20:52:48.598703 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.598438 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.582149 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:48.599344 1720 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:48.599720 1646 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
W20251215 20:52:48.590770 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.583000 1686 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:48.561923 2638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.193s user 0.008s sys 0.021s
W20251215 20:52:48.578979 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 1.27756e+06us
W20251215 20:52:48.562230 2736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.278s user 0.007s sys 0.024s
I20251215 20:52:48.479715 2737 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.612507 1793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 687) took 3121 ms. Trace:
I20251215 20:52:48.586073 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:48.580545 1721 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:48.614688 1645 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:48.511930 1643 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
W20251215 20:52:48.500346 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 745008us
I20251215 20:52:48.522178 2722 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.574975 2765 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.575955 2760 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:48.604898 1761 leader_election.cc:336] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.714s (SENT)
I20251215 20:52:48.631088 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.606505 1686 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:48.574620 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.588999 2866 raft_consensus.cc:2749] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:48.521812 2808 raft_consensus.cc:2764] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20251215 20:52:48.620517 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.615911 1793 rpcz_store.cc:276] 1215 20:52:45.495866 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.564059 (+ 68193us) service_pool.cc:225] Handling call
1215 20:52:45.839070 (+275011us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800002a98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:45.839312 (+ 242us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:45.839706 (+ 394us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:45.839735 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:45.840347 (+ 612us) log.cc:844] Serialized 26 byte log entry
1215 20:52:46.752141 (+911794us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:48.429205 (+1677064us) log.cc:844] Serialized 14 byte log entry
1215 20:52:48.597781 (+168576us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.597904 (+ 123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.597969 (+ 65us) raft_consensus.cc:1685] finished
1215 20:52:48.612216 (+ 14247us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.612434 (+ 218us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1634821,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":128248,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":76290,"spinlock_wait_cycles":24939776,"thread_start_us":2641863,"threads_started":3,"wal-append.queue_time_us":1416134,"wal-append.run_cpu_time_us":2538,"wal-append.run_wall_time_us":1081891}
I20251215 20:52:48.622228 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:48.682135 1646 raft_consensus.cc:2393] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:48.624202 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:48.626386 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.628638 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:48.687937 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:48.650724 1758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 59546.8us
I20251215 20:52:48.707636 1719 raft_consensus.cc:2376] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4. Re-sending same reply.
W20251215 20:52:48.707867 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.602434 2315 pending_rounds.cc:107] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20251215 20:52:48.658396 1716 raft_consensus.cc:1240] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 1. Current term is 3. Ops: []
I20251215 20:52:48.604395 2638 raft_consensus.cc:697] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:48.657553 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:48.621857 2806 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:48.649627 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:48.725637 1717 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:48.607100 2861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s user 0.014s sys 0.040s
I20251215 20:52:48.655954 1645 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:48.680846 2935 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:48.736558 2935 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:48.677294 2968 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:48.621423 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:48.685212 2679 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.737560 1713 raft_consensus.cc:2376] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
W20251215 20:52:48.738476 2853 consensus_meta.cc:287] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.636s user 0.010s sys 0.000s
I20251215 20:52:48.738585 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:48.661157 2760 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:48.625063 2818 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
W20251215 20:52:48.675608 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 69176.9us
I20251215 20:52:48.584504 1787 rpcz_store.cc:276] 1215 20:52:45.761709 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.077915 (+2316206us) service_pool.cc:225] Handling call
1215 20:52:48.102025 (+ 24110us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:48.441502 (+339477us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.454007 (+ 12505us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.682679 1720 raft_consensus.cc:2376] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
I20251215 20:52:48.740876 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.741420 1720 raft_consensus.cc:2376] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
I20251215 20:52:48.625336 2850 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:48.737049 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:48.742076 2850 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.742919 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:48.743541 1641 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:48.744616 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.737080 2935 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:48.732625 1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 837) took 1982 ms. Trace:
I20251215 20:52:48.744640 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.701107 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:48.746758 1718 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
W20251215 20:52:48.703544 2958 log.cc:927] Time spent T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20251215 20:52:48.704576 1712 raft_consensus.cc:2393] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:48.606312 2775 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.747627 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.748565 1788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 695) took 3020 ms. Trace:
I20251215 20:52:48.705255 1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 832) took 2377 ms. Trace:
I20251215 20:52:48.660632 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:48.745754 1642 rpcz_store.cc:276] 1215 20:52:46.750211 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:47.124891 (+374680us) service_pool.cc:225] Handling call
1215 20:52:47.125395 (+ 504us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:47.226264 (+100869us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:47.226302 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:47.226865 (+ 563us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.595594 (+1368729us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.603746 (+ 8152us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.617660 (+ 13914us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.732374 (+114714us) raft_consensus.cc:1685] finished
1215 20:52:48.732397 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.732556 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":100361,"raft.queue_time_us":112457,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":1356945,"threads_started":1,"wal-append.queue_time_us":1398496}
W20251215 20:52:48.649493 1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1014) took 1242 ms (client timeout 1529 ms). Trace:
I20251215 20:52:48.713330 1791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 693) took 3155 ms. Trace:
I20251215 20:52:48.750509 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:48.673121 1637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 830) took 2631 ms. Trace:
I20251215 20:52:48.749493 1721 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
W20251215 20:52:48.720822 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.764859 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:48.765812 1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1002) took 1454 ms. Trace:
I20251215 20:52:48.729207 1645 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
W20251215 20:52:48.675254 1761 connection.cc:232] RPC call timeout handler was delayed by -1.3259988679999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20251215 20:52:48.731455 1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 668) took 3322 ms. Trace:
W20251215 20:52:48.732748 2924 consensus_meta.cc:287] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.642s user 0.009s sys 0.000s
W20251215 20:52:48.734241 1715 consensus_meta.cc:287] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.815s user 0.009s sys 0.000s
W20251215 20:52:48.728456 2861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s user 0.016s sys 0.044s
I20251215 20:52:48.735149 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:48.732529 2806 raft_consensus.cc:697] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:48.739279 1713 raft_consensus.cc:2376] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2. Re-sending same reply.
I20251215 20:52:48.661710 2320 raft_consensus.cc:2955] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:48.718989 2866 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:48.746946 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:48.751637 1641 raft_consensus.cc:2410] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20251215 20:52:48.807585 2866 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.745347 1719 raft_consensus.cc:2468] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
W20251215 20:52:48.809660 1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.809878 2866 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.766160 1646 rpcz_store.cc:276] 1215 20:52:47.311158 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.719337 (+1408179us) service_pool.cc:225] Handling call
1215 20:52:48.765745 (+ 46408us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:48.766736 1761 leader_election.cc:336] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.725s (SENT)
I20251215 20:52:48.767462 1760 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:48.750865 1791 rpcz_store.cc:276] 1215 20:52:45.558171 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.742220 (+1184049us) service_pool.cc:225] Handling call
1215 20:52:46.742605 (+ 385us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.746973 (+ 4368us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.747004 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.752790 (+ 5786us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.364227 (+1611437us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.364280 (+ 53us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.364383 (+ 103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.713114 (+348731us) raft_consensus.cc:1685] finished
1215 20:52:48.713135 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.713272 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3889,"raft.queue_time_us":9922,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":14309,"thread_start_us":1583438,"threads_started":1,"wal-append.queue_time_us":1841436}
I20251215 20:52:48.769366 1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1005) took 1457 ms. Trace:
I20251215 20:52:48.741466 2760 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.763340 2853 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:48.763311 1637 rpcz_store.cc:276] 1215 20:52:46.029138 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.293654 (+264516us) service_pool.cc:225] Handling call
1215 20:52:46.331513 (+ 37859us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:46.361926 (+ 30413us) raft_consensus.cc:1534] Early marking committed up to index 2
1215 20:52:48.265601 (+1903675us) log.cc:844] Serialized 14 byte log entry
1215 20:52:48.600080 (+334479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:48.611959 (+ 11879us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:48.614162 (+ 2203us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.624428 (+ 10266us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.660666 (+ 36238us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25084,"prepare.queue_time_us":228940,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":6986,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14212,"thread_start_us":2003681,"threads_started":2}
I20251215 20:52:48.791922 1717 raft_consensus.cc:2368] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3.
I20251215 20:52:48.749634 1639 rpcz_store.cc:276] 1215 20:52:46.327486 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.738792 (+411306us) service_pool.cc:225] Handling call
1215 20:52:46.755123 (+ 16331us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.763332 (+ 8209us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.763371 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.764756 (+ 1385us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.371765 (+1607009us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.371808 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.371882 (+ 74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.705003 (+333121us) raft_consensus.cc:1685] finished
1215 20:52:48.705025 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.705191 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1306,"raft.queue_time_us":1503,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13517,"thread_start_us":1549963,"threads_started":1,"wal-append.queue_time_us":1798712}
I20251215 20:52:48.717710 2315 raft_consensus.cc:2917] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20251215 20:52:48.797376 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:48.578909 2923 consensus_queue.cc:237] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.795958 1715 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:48.786388 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:48.803277 2852 raft_consensus.cc:3055] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:48.739506 2940 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.804165 1642 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de"
I20251215 20:52:48.804782 2638 consensus_queue.cc:237] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.804980 2806 consensus_queue.cc:237] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:48.805977 1786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38896 (request call id 73) took 3046 ms. Trace:
I20251215 20:52:48.806268 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:48.806824 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.749102 1788 rpcz_store.cc:276] 1215 20:52:45.728059 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.743234 (+1015175us) service_pool.cc:225] Handling call
1215 20:52:46.743584 (+ 350us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.773664 (+ 30080us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.773707 (+ 43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.774165 (+ 458us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.403903 (+1629738us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.403943 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.404022 (+ 79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.748357 (+344335us) raft_consensus.cc:1685] finished
1215 20:52:48.748379 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.748505 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12034,"raft.queue_time_us":14413,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":135,"thread_start_us":1574704,"threads_started":1,"wal-append.queue_time_us":1776407}
I20251215 20:52:48.749110 2775 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:48.749111 2735 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:48.737236 2874 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:48.815832 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 161860us
I20251215 20:52:48.811477 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:48.914013 1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59670 (request call id 68) took 2634 ms. Trace:
W20251215 20:52:49.422317 1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.308629 1543 catalog_manager.cc:5654] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.498046 1789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38896 (request call id 72) took 3769 ms. Trace:
W20251215 20:52:48.984421 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:49.162847 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.522487 1721 raft_consensus.cc:2376] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
W20251215 20:52:49.523203 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:49.523584 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:48.811851 1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 762) took 2090 ms. Trace:
I20251215 20:52:49.524474 1716 rpcz_store.cc:276] 1215 20:52:46.708005 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:47.083948 (+375943us) service_pool.cc:225] Handling call
1215 20:52:47.085928 (+ 1980us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:48.713411 (+1627483us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.798334 (+ 84923us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540023e954. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:48.798527 (+ 193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3615437056}
I20251215 20:52:49.501032 1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 819) took 1117 ms. Trace:
I20251215 20:52:49.525568 1717 rpcz_store.cc:276] 1215 20:52:48.384042 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.728282 (+344240us) service_pool.cc:225] Handling call
1215 20:52:49.500962 (+772680us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:48.822714 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:49.501549 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 734052us
W20251215 20:52:49.498185 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.263576 1542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47186 (request call id 70) took 6109 ms. Trace:
I20251215 20:52:49.498731 1641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:49.517091 1761 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:49.500975 1645 rpcz_store.cc:276] 1215 20:52:47.312046 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.728930 (+1416884us) service_pool.cc:225] Handling call
1215 20:52:48.769286 (+ 40356us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.522493 1543 catalog_manager.cc:5654] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.448621 2318 raft_consensus.cc:1275] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20251215 20:52:49.519629 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.076889 1686 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:49.522492 1639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:49.502092 1792 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
W20251215 20:52:49.306231 2935 consensus_meta.cc:287] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Time spent flushing consensus metadata: real 0.555s user 0.007s sys 0.002s
W20251215 20:52:49.126976 2936 consensus_meta.cc:287] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.732s user 0.010s sys 0.001s
W20251215 20:52:49.527866 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.536049 1646 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:49.546229 1646 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:49.533807 1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1028) took 1080 ms. Trace:
I20251215 20:52:49.547431 1639 rpcz_store.cc:276] 1215 20:52:48.453564 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.522214 (+1068650us) service_pool.cc:225] Handling call
1215 20:52:49.533748 (+ 11534us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:49.530898 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.533892 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:49.536608 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:49.527107 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.537462 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:49.544876 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:49.315302 2976 log.cc:927] Time spent T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.052s user 0.000s sys 0.001s
W20251215 20:52:49.257705 2979 log.cc:927] Time spent T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.075s user 0.000s sys 0.001s
W20251215 20:52:49.284224 2975 log.cc:927] Time spent T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.200s user 0.000s sys 0.000s
W20251215 20:52:49.033520 2319 consensus_meta.cc:287] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: Time spent flushing consensus metadata: real 0.524s user 0.007s sys 0.003s
I20251215 20:52:49.179374 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:49.396279 2679 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:49.535470 2969 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:49.538992 2775 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:49.539834 2317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:49.526932 2967 raft_consensus.cc:2804] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:48.914848 2977 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:49.543267 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.522706 1789 rpcz_store.cc:276] 1215 20:52:45.728425 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.759833 (+1031408us) service_pool.cc:225] Handling call
1215 20:52:46.760235 (+ 402us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.765009 (+ 4774us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.765059 (+ 50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.774426 (+ 9367us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.450837 (+1676411us) raft_consensus.cc:1645] Marking committed up to 4
1215 20:52:48.450883 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.451282 (+ 399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:49.497793 (+1046511us) raft_consensus.cc:1685] finished
1215 20:52:49.497820 (+ 27us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.497976 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3368,"raft.queue_time_us":3555,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":11347,"thread_start_us":1621861,"threads_started":1,"wal-append.queue_time_us":2175152}
I20251215 20:52:49.566881 1639 raft_consensus.cc:1240] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 2. Current term is 3. Ops: []
W20251215 20:52:49.567689 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.568137 1795 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:49.522086 2853 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:49.598069 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.530287 1543 catalog_manager.cc:5654] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
W20251215 20:52:49.528868 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 762035us
W20251215 20:52:49.598631 1761 connection.cc:232] RPC call timeout handler was delayed by -1.3063879910000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
I20251215 20:52:49.599632 1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1007) took 2283 ms. Trace:
I20251215 20:52:48.799129 2911 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:49.570781 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:49.571067 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:49.538552 2866 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:49.571415 2935 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.538416 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.521318 1640 rpcz_store.cc:276] 1215 20:52:46.279609 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.729777 (+450168us) service_pool.cc:225] Handling call
1215 20:52:46.760865 (+ 31088us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.761318 (+ 453us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.761349 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:46.815272 (+ 53923us) log.cc:844] Serialized 26 byte log entry
1215 20:52:47.138633 (+323361us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4800001d58. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30c2c14e21 00007f30c2c0beb7 00007f30c2c0bd4a 00007f30c2d02f7f 00007f30c2d02c47 00007f30c2d1726c 00007f30c2d17218 00007f30c2d17198 00007f30c2d17153 00007f30c2d163fc 00007f30c1c51516
1215 20:52:48.501264 (+1362631us) raft_consensus.cc:1645] Marking committed up to 4
1215 20:52:48.501315 (+ 51us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.501394 (+ 79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:48.810063 (+308669us) raft_consensus.cc:1685] finished
1215 20:52:48.810088 (+ 25us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.913914 (+103826us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":89001,"raft.queue_time_us":234,"raft.run_cpu_time_us":11857,"raft.run_wall_time_us":376044,"spinlock_wait_cycles":10742656,"thread_start_us":1616036,"threads_started":1,"wal-append.queue_time_us":1957206}
W20251215 20:52:48.763746 1643 rpcz_store.cc:269] 1215 20:52:47.386653 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:47.557653 (+171000us) service_pool.cc:225] Handling call
1215 20:52:48.629080 (+1071427us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:48.942700 2861 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:49.593241 2312 raft_consensus.cc:2468] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:48.962504 2818 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:49.576627 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:49.610493 1788 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:49.610845 1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 818) took 1227 ms. Trace:
W20251215 20:52:49.572095 1760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.577327 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:49.576506 2318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:49.611203 1716 rpcz_store.cc:276] 1215 20:52:48.383751 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.525393 (+1141642us) service_pool.cc:225] Handling call
1215 20:52:49.610784 (+ 85391us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.580550 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.581386 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:49.586578 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.613252 1720 raft_consensus.cc:2376] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4. Re-sending same reply.
I20251215 20:52:49.613379 1791 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 1.
I20251215 20:52:49.613574 1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 843) took 1047 ms. Trace:
I20251215 20:52:49.614347 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 823) took 1229 ms. Trace:
I20251215 20:52:49.614706 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:49.614969 1720 rpcz_store.cc:276] 1215 20:52:48.385318 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.521541 (+1136223us) service_pool.cc:225] Handling call
1215 20:52:49.614286 (+ 92745us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:49.536667 1715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 782) took 2237 ms (client timeout 1764 ms). Trace:
I20251215 20:52:49.538232 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:49.616962 2318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:49.617635 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:49.618119 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.569625 1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 834) took 3223 ms. Trace:
I20251215 20:52:49.618287 2818 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.619282 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.620039 1720 raft_consensus.cc:2393] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:49.528163 1542 rpcz_store.cc:276] 1215 20:52:43.146238 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:43.149784 (+ 3546us) service_pool.cc:225] Handling call
1215 20:52:49.255728 (+6105944us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:45.564998 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:45.565640 (+ 642us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:45.565685 (+ 45us) write_op.cc:435] Acquired schema lock
1215 20:52:45.565705 (+ 20us) tablet.cc:660] Decoding operations
1215 20:52:45.692589 (+126884us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:45.692679 (+ 90us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:45.692712 (+ 33us) tablet.cc:683] Acquiring locks for 3 operations
1215 20:52:45.835820 (+143108us) tablet.cc:699] Row locks acquired
1215 20:52:45.842538 (+ 6718us) write_op.cc:260] PREPARE: finished
1215 20:52:45.898981 (+ 56443us) write_op.cc:270] Start()
1215 20:52:45.911518 (+ 12537us) write_op.cc:276] Timestamp: P: 1765831965895080 usec, L: 0
1215 20:52:45.911545 (+ 27us) op_driver.cc:348] REPLICATION: starting
1215 20:52:45.912242 (+ 697us) log.cc:844] Serialized 1301 byte log entry
1215 20:52:46.667565 (+755323us) op_driver.cc:464] REPLICATION: finished
1215 20:52:48.705056 (+2037491us) write_op.cc:301] APPLY: starting
1215 20:52:48.705169 (+ 113us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:48.705296 (+ 127us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:48.711613 (+ 6317us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:48.712163 (+ 550us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:48.712363 (+ 200us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
1215 20:52:48.712405 (+ 42us) write_op.cc:312] APPLY: finished
1215 20:52:48.712620 (+ 215us) log.cc:844] Serialized 34 byte log entry
1215 20:52:49.076417 (+363797us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:49.125674 (+ 49257us) write_op.cc:454] Released schema lock
1215 20:52:49.167512 (+ 41838us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:49.245598 (+ 78086us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:49.259741 (+ 14143us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":119842,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":1993050,"apply.run_cpu_time_us":12588,"apply.run_wall_time_us":526950,"num_ops":3,"prepare.queue_time_us":122763,"prepare.run_cpu_time_us":4115,"prepare.run_wall_time_us":347599,"replication_time_us":755848,"thread_start_us":1948457,"threads_started":3}]]}
I20251215 20:52:49.575634 2735 raft_consensus.cc:2749] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:49.536320 2315 raft_consensus.cc:2889] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20251215 20:52:49.617262 1715 rpcz_store.cc:269] 1215 20:52:47.284602 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:47.384391 (+ 99789us) service_pool.cc:225] Handling call
1215 20:52:49.517036 (+2132645us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.591984 1642 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:49.599756 1761 connection.cc:232] RPC call timeout handler was delayed by -1.0375671629999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20251215 20:52:48.796772 2924 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:49.626353 1761 connection.cc:232] RPC call timeout handler was delayed by -1.030367162999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20251215 20:52:49.598357 1717 raft_consensus.cc:2468] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:49.599457 1543 catalog_manager.cc:5654] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.626945 1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 692) took 1047 ms. Trace:
W20251215 20:52:49.626725 1761 connection.cc:232] RPC call timeout handler was delayed by -1.0168671630000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20251215 20:52:48.786705 1714 rpcz_store.cc:276] 1215 20:52:45.409463 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:45.417154 (+ 7691us) service_pool.cc:225] Handling call
1215 20:52:45.460728 (+ 43574us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:48.502551 (+3041823us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.731174 (+228623us) spinlock_profiling.cc:243] Waited 2.97 s on lock 0x7b54002094d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:48.731387 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6831273856}
I20251215 20:52:49.600059 1639 rpcz_store.cc:276] 1215 20:52:47.315919 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.548103 (+2232184us) service_pool.cc:225] Handling call
1215 20:52:49.566691 (+ 18588us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.599350 (+ 32659us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.599569 (+ 219us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.588693 1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 845) took 1019 ms. Trace:
I20251215 20:52:49.586133 2319 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:49.589246 2973 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:49.587313 2940 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:49.597815 1637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:49.607178 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:49.649114 1795 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:49.608410 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:49.516692 2852 raft_consensus.cc:740] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:49.605911 2313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:49.576783 2320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s user 0.007s sys 0.007s
I20251215 20:52:49.611589 1792 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:49.075634 2850 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.607499 1790 raft_consensus.cc:2468] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:49.602579 2967 raft_consensus.cc:697] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:49.615417 1789 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:49.620698 2311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:49.576859 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.593721 2679 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.614003 1721 rpcz_store.cc:276] 1215 20:52:48.565905 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.546267 (+980362us) service_pool.cc:225] Handling call
1215 20:52:49.613511 (+ 67244us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.620481 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 825) took 1234 ms. Trace:
I20251215 20:52:49.653877 1720 rpcz_store.cc:276] 1215 20:52:48.385965 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.619006 (+1233041us) service_pool.cc:225] Handling call
1215 20:52:49.620424 (+ 1418us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.654412 2850 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:49.654866 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.655030 2850 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.655458 2679 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.650593 1637 raft_consensus.cc:2393] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:49.653939 1719 raft_consensus.cc:2393] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:49.655644 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 853) took 1059 ms. Trace:
W20251215 20:52:49.628497 1761 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.509s (SENT)
W20251215 20:52:49.613873 2960 negotiation.cc:337] Failed RPC negotiation. Trace:
1215 20:52:46.321733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.106.129:38541 (local address 127.0.0.1:54200)
1215 20:52:47.137109 (+815376us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b440002304c. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bab5bed5 00007f30bab5c8f2 00007f30bd8a657b 00007f30bd8a1e4f 00007f30bac2fc1c 00007f30c3a177e9 00007f30bac4c28b 00007f30bac4a52f 00007f30bac4c7f2 00007f30bbfe0b38
1215 20:52:48.676858 (+1539749us) negotiation.cc:107] Waiting for socket to connect
1215 20:52:48.676931 (+ 73us) client_negotiation.cc:174] Beginning negotiation
1215 20:52:48.677411 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1215 20:52:49.241373 (+563962us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.0.106.129:38541: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2266918,"spinlock_wait_cycles":349795072,"thread_start_us":1997123,"threads_started":1}
I20251215 20:52:49.631021 1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1016) took 1715 ms. Trace:
I20251215 20:52:49.608958 2923 raft_consensus.cc:2749] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:49.627524 1543 catalog_manager.cc:5654] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.597011 2775 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:49.620471 2818 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:49.620915 2985 negotiation.cc:337] Failed RPC negotiation. Trace:
1215 20:52:48.588111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54200 (local address 127.0.106.129:38541)
1215 20:52:49.541054 (+952943us) server_negotiation.cc:207] Beginning negotiation
1215 20:52:49.541092 (+ 38us) server_negotiation.cc:400] Waiting for connection header
1215 20:52:49.541153 (+ 61us) server_negotiation.cc:408] Connection header received
1215 20:52:49.541331 (+ 178us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1215 20:52:49.541369 (+ 38us) server_negotiation.cc:462] Received NEGOTIATE request from client
1215 20:52:49.541719 (+ 350us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1215 20:52:49.542257 (+ 538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54200: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":952226,"thread_start_us":127193,"threads_started":1}
I20251215 20:52:49.633592 1713 rpcz_store.cc:276] 1215 20:52:48.566400 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.805960 (+239560us) service_pool.cc:225] Handling call
1215 20:52:49.585814 (+779854us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.663411 2852 consensus_queue.cc:260] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.664513 2852 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:49.618765 1638 rpcz_store.cc:276] 1215 20:52:46.346440 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.759028 (+412588us) service_pool.cc:225] Handling call
1215 20:52:46.831974 (+ 72946us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:46.973795 (+141821us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:46.975769 (+ 1974us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:47.092820 (+117051us) log.cc:844] Serialized 26 byte log entry
1215 20:52:48.504534 (+1411714us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:48.507077 (+ 2543us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.512403 (+ 5326us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:49.498342 (+985939us) raft_consensus.cc:1685] finished
1215 20:52:49.516159 (+ 17817us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.535875 (+ 19716us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15046,"raft.queue_time_us":99833,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":31156,"thread_start_us":1350943,"threads_started":1,"wal-append.queue_time_us":2213296}
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:432: Failure
Failed
Bad status: Timed out: Client connection negotiation failed: client connection to 127.0.106.129:38541: received 0 of 4 requested bytes
I20251215 20:52:49.595825 2969 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.646215 1644 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:49.645732 2319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53414 (request call id 132) took 1379 ms. Trace:
I20251215 20:52:49.634788 1643 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9b3367a5854f49b98da54556a209b0de" is_pre_election: true
I20251215 20:52:49.609870 2861 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.608911 2866 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.649673 1793 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
W20251215 20:52:49.609333 1685 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34150 dropped due to backpressure: service queue is full with 50 items
I20251215 20:52:49.648406 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.601504 2977 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:49.603753 2911 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:49.632723 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:49.650863 2320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s user 0.007s sys 0.007s
I20251215 20:52:49.690194 2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53414 (request call id 138) took 1068 ms. Trace:
I20251215 20:52:49.690610 2320 rpcz_store.cc:276] 1215 20:52:48.652103 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.661066 (+ 8963us) service_pool.cc:225] Handling call
1215 20:52:48.661380 (+ 314us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:48.661598 (+ 218us) raft_consensus.cc:1534] Early marking committed up to index 4
1215 20:52:48.913827 (+252229us) log.cc:844] Serialized 14 byte log entry
1215 20:52:49.689787 (+775960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.689853 (+ 66us) raft_consensus.cc:1645] Marking committed up to 4
1215 20:52:49.689899 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.689979 (+ 80us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.690118 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":775565,"threads_started":1,"wal-append.queue_time_us":707667}
I20251215 20:52:49.627341 1717 rpcz_store.cc:276] 1215 20:52:48.579505 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.542937 (+963432us) service_pool.cc:225] Handling call
1215 20:52:49.626882 (+ 83945us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.656807 1720 rpcz_store.cc:276] 1215 20:52:48.596187 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.654587 (+1058400us) service_pool.cc:225] Handling call
1215 20:52:49.655587 (+ 1000us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.657266 1761 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:49.655963 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:49.693621 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 65141.1us
I20251215 20:52:49.651926 2940 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.656004 2679 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:49.660910 1543 catalog_manager.cc:5654] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.677244 1795 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 3.
I20251215 20:52:49.671039 2853 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.661985 2311 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:49.659634 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.671290 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
W20251215 20:52:49.683851 1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1001) took 2373 ms (client timeout 2041 ms). Trace:
I20251215 20:52:49.687939 1716 raft_consensus.cc:3060] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:49.679384 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.671270 2924 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:49.694291 1761 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.519s (SENT)
I20251215 20:52:49.649955 2973 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:49.702234 1761 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:49.658876 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 824) took 1273 ms. Trace:
I20251215 20:52:49.702836 1719 rpcz_store.cc:276] 1215 20:52:48.385622 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.522796 (+1137174us) service_pool.cc:225] Handling call
1215 20:52:49.658817 (+136021us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.662295 2874 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.659397 1640 rpcz_store.cc:276] 1215 20:52:47.915344 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.611542 (+1696198us) service_pool.cc:225] Handling call
1215 20:52:49.630358 (+ 18816us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.630671 (+ 313us) raft_consensus.cc:1534] Early marking committed up to index 2
1215 20:52:49.630699 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.630742 (+ 43us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:49.630773 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.630829 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.630958 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.671523 1637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43814 (request call id 1030) took 1168 ms. Trace:
I20251215 20:52:49.663360 2967 consensus_queue.cc:237] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.697881 1543 catalog_manager.cc:5654] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.703881 1637 rpcz_store.cc:276] 1215 20:52:48.493615 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.536995 (+1043380us) service_pool.cc:225] Handling call
1215 20:52:49.662095 (+125100us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.704727 1543 catalog_manager.cc:5654] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.705632 1637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1022) took 1403 ms. Trace:
I20251215 20:52:49.705746 2977 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:49.699582 1721 raft_consensus.cc:2393] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:49.701004 1644 rpcz_store.cc:269] 1215 20:52:47.310857 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.385796 (+1074939us) service_pool.cc:225] Handling call
1215 20:52:49.683701 (+1297905us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540005d7d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:49.683790 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2895866112}
I20251215 20:52:49.707157 1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 830) took 1255 ms. Trace:
I20251215 20:52:49.707552 1721 rpcz_store.cc:276] 1215 20:52:48.451771 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.653735 (+1201964us) service_pool.cc:225] Handling call
1215 20:52:49.707079 (+ 53344us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.709525 1543 catalog_manager.cc:5654] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 3, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.710738 1543 catalog_manager.cc:5654] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 3, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:49.688714 1643 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 3.
I20251215 20:52:49.680424 2319 rpcz_store.cc:276] 1215 20:52:48.268542 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.280201 (+ 11659us) service_pool.cc:225] Handling call
1215 20:52:49.642465 (+1362264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.718940 1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1024) took 1337 ms. Trace:
I20251215 20:52:49.719403 1644 rpcz_store.cc:276] 1215 20:52:48.381863 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.707138 (+1325275us) service_pool.cc:225] Handling call
1215 20:52:49.718417 (+ 11279us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.718610 (+ 193us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.718635 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.718683 (+ 48us) raft_consensus.cc:1645] Marking committed up to 3
1215 20:52:49.718714 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.718771 (+ 57us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.718883 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.723079 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 848) took 1155 ms. Trace:
I20251215 20:52:49.723508 1718 rpcz_store.cc:276] 1215 20:52:48.567266 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.747385 (+180119us) service_pool.cc:225] Handling call
1215 20:52:49.722859 (+975474us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400292cd4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:49.723001 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2223126912}
I20251215 20:52:49.516358 1786 rpcz_store.cc:276] 1215 20:52:45.759609 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:47.191045 (+1431436us) service_pool.cc:225] Handling call
1215 20:52:47.191354 (+ 309us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:47.192137 (+ 783us) raft_consensus.cc:1534] Early marking committed up to index 5
1215 20:52:48.595538 (+1403401us) log.cc:844] Serialized 14 byte log entry
1215 20:52:48.799396 (+203858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:48.805620 (+ 6224us) raft_consensus.cc:1645] Marking committed up to 5
1215 20:52:48.805684 (+ 64us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:48.805789 (+ 105us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:48.805916 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23111,"prepare.queue_time_us":1195042,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":27815,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4962,"thread_start_us":1447809,"threads_started":2,"wal-append.queue_time_us":995281}
I20251215 20:52:49.725042 1644 raft_consensus.cc:1275] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:49.717839 1712 raft_consensus.cc:2393] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:49.728048 1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 820) took 1343 ms. Trace:
I20251215 20:52:49.728497 1712 rpcz_store.cc:276] 1215 20:52:48.384360 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.602338 (+1217978us) service_pool.cc:225] Handling call
1215 20:52:49.727985 (+125647us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.724699 2935 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.724050 1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1021) took 1447 ms. Trace:
I20251215 20:52:49.727108 1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1027) took 1300 ms. Trace:
I20251215 20:52:49.733889 1644 rpcz_store.cc:276] 1215 20:52:48.427068 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.723095 (+1296027us) service_pool.cc:225] Handling call
1215 20:52:49.724718 (+ 1623us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.726770 (+ 2052us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.726999 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.733879 1640 rpcz_store.cc:276] 1215 20:52:48.277054 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.712615 (+1435561us) service_pool.cc:225] Handling call
1215 20:52:49.723568 (+ 10953us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.723747 (+ 179us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.723774 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.723818 (+ 44us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:49.723847 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.723897 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.723998 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.712471 1715 raft_consensus.cc:2376] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2. Re-sending same reply.
I20251215 20:52:49.732692 1714 raft_consensus.cc:2393] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:49.685707 1685 service_pool.cc:138] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34150 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 833)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 702)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 786)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 809)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 693)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 863)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 706)
I20251215 20:52:49.712208 2679 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.725582 1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1019) took 1807 ms. Trace:
I20251215 20:52:49.746884 1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 845) took 1241 ms. Trace:
I20251215 20:52:49.747323 1644 rpcz_store.cc:276] 1215 20:52:48.505789 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.735439 (+1229650us) service_pool.cc:225] Handling call
1215 20:52:49.741138 (+ 5699us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.746520 (+ 5382us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.746556 (+ 36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.746606 (+ 50us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:49.746641 (+ 35us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.746706 (+ 65us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.746827 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2784}
I20251215 20:52:49.749198 2866 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:49.749579 2991 log.cc:927] Time spent T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.100s user 0.001s sys 0.000s
I20251215 20:52:49.751072 1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 847) took 1222 ms. Trace:
I20251215 20:52:49.751520 1640 rpcz_store.cc:276] 1215 20:52:48.528684 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.736032 (+1207348us) service_pool.cc:225] Handling call
1215 20:52:49.748545 (+ 12513us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.750502 (+ 1957us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.750628 (+ 126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.750677 (+ 49us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:49.750707 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.750765 (+ 58us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.751017 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.706221 1637 rpcz_store.cc:276] 1215 20:52:48.302270 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.704738 (+1402468us) service_pool.cc:225] Handling call
1215 20:52:49.705085 (+ 347us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.705262 (+ 177us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.705300 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.705361 (+ 61us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:49.705396 (+ 35us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.705456 (+ 60us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.705576 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.740778 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.742125 2850 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.741504 1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 826) took 1353 ms. Trace:
W20251215 20:52:49.750031 2982 log.cc:927] Time spent T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.154s user 0.002s sys 0.000s
I20251215 20:52:49.749812 1643 raft_consensus.cc:1240] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:49.758270 1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 848) took 1085 ms. Trace:
I20251215 20:52:49.761613 1644 rpcz_store.cc:276] 1215 20:52:48.672648 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.748365 (+1075717us) service_pool.cc:225] Handling call
1215 20:52:49.757584 (+ 9219us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.757759 (+ 175us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.757784 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.757953 (+ 169us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:49.758015 (+ 62us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.758076 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.758204 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.762917 1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59670 (request call id 72) took 1056 ms. Trace:
I20251215 20:52:49.750177 1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 829) took 1305 ms. Trace:
I20251215 20:52:49.749720 2911 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:49.763902 1640 rpcz_store.cc:276] 1215 20:52:48.706258 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.752912 (+1046654us) service_pool.cc:225] Handling call
1215 20:52:49.761873 (+ 8961us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.762621 (+ 748us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.762650 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.762687 (+ 37us) raft_consensus.cc:1645] Marking committed up to 5
1215 20:52:49.762709 (+ 22us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.762752 (+ 43us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.762859 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.772509 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.774117 1717 raft_consensus.cc:3060] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:49.772930 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.670284 1638 raft_consensus.cc:2955] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:49.776821 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 854) took 1168 ms. Trace:
I20251215 20:52:49.777225 1718 rpcz_store.cc:276] 1215 20:52:48.608212 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.760637 (+1152425us) service_pool.cc:225] Handling call
1215 20:52:49.776760 (+ 16123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.743182 1642 rpcz_store.cc:276] 1215 20:52:47.916183 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.650808 (+1734625us) service_pool.cc:225] Handling call
1215 20:52:49.694310 (+ 43502us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.699163 (+ 4853us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.700845 (+ 1682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.711835 (+ 10990us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:49.711903 (+ 68us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.717404 (+ 5501us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.723210 (+ 5806us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.761229 1713 raft_consensus.cc:2376] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
I20251215 20:52:49.775490 2861 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.775786 2257 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:49.853128 2679 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.854002 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.854472 1637 raft_consensus.cc:1240] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:49.766803 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.777009 1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43800 (request call id 843) took 1271 ms. Trace:
I20251215 20:52:49.856770 2940 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:49.871301 1721 raft_consensus.cc:2468] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:49.857556 2973 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:49.759770 1715 rpcz_store.cc:276] 1215 20:52:48.386269 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.635191 (+1248922us) service_pool.cc:225] Handling call
1215 20:52:49.739555 (+104364us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.764868 1714 rpcz_store.cc:276] 1215 20:52:48.444377 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.642012 (+1197635us) service_pool.cc:225] Handling call
1215 20:52:49.746202 (+104190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.776702 2775 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:49.864890 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.866235 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.870965 1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 832) took 1407 ms. Trace:
I20251215 20:52:49.870643 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.881326 1718 raft_consensus.cc:2376] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2. Re-sending same reply.
I20251215 20:52:49.883877 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 835) took 1374 ms. Trace:
I20251215 20:52:49.868703 1719 raft_consensus.cc:2376] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2. Re-sending same reply.
I20251215 20:52:49.884200 1718 rpcz_store.cc:276] 1215 20:52:48.509502 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.777944 (+1268442us) service_pool.cc:225] Handling call
1215 20:52:49.883820 (+105876us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.884814 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 834) took 1380 ms. Trace:
I20251215 20:52:49.873055 1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 852) took 1304 ms. Trace:
I20251215 20:52:49.779103 2969 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:49.874454 1716 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:49.879598 1717 raft_consensus.cc:2468] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:49.885495 1721 rpcz_store.cc:276] 1215 20:52:48.573437 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.760128 (+1186691us) service_pool.cc:225] Handling call
1215 20:52:49.872994 (+112866us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.886044 1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 831) took 1427 ms. Trace:
I20251215 20:52:49.885164 1719 rpcz_store.cc:276] 1215 20:52:48.504793 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.775081 (+1270288us) service_pool.cc:225] Handling call
1215 20:52:49.884754 (+109673us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.886372 1717 rpcz_store.cc:276] 1215 20:52:48.458881 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.764788 (+1305907us) service_pool.cc:225] Handling call
1215 20:52:49.885991 (+121203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.884394 1720 raft_consensus.cc:2376] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2. Re-sending same reply.
I20251215 20:52:49.887373 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 833) took 1397 ms. Trace:
I20251215 20:52:49.887696 1720 rpcz_store.cc:276] 1215 20:52:48.490165 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.776044 (+1285879us) service_pool.cc:225] Handling call
1215 20:52:49.887309 (+111265us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.885767 1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 861) took 1144 ms. Trace:
I20251215 20:52:49.888652 1716 rpcz_store.cc:276] 1215 20:52:48.741298 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.620992 (+879694us) service_pool.cc:225] Handling call
1215 20:52:49.885709 (+264717us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.889838 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.874706 2911 raft_consensus.cc:2804] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20251215 20:52:49.872267 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 108415us
I20251215 20:52:49.894639 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.895499 1719 raft_consensus.cc:2393] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:49.895941 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 858) took 1167 ms. Trace:
I20251215 20:52:49.896251 1719 rpcz_store.cc:276] 1215 20:52:48.728406 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.886785 (+1158379us) service_pool.cc:225] Handling call
1215 20:52:49.895873 (+ 9088us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.897254 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.898059 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 844) took 1331 ms. Trace:
I20251215 20:52:49.898393 1719 rpcz_store.cc:276] 1215 20:52:48.566153 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.896965 (+1330812us) service_pool.cc:225] Handling call
1215 20:52:49.898000 (+ 1035us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.899379 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.900202 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 695) took 1148 ms. Trace:
I20251215 20:52:49.900574 1718 rpcz_store.cc:276] 1215 20:52:48.752117 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.884923 (+1132806us) service_pool.cc:225] Handling call
1215 20:52:49.900150 (+ 15227us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.903164 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.904034 1720 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:49.904517 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 842) took 1338 ms. Trace:
I20251215 20:52:49.904844 1720 rpcz_store.cc:276] 1215 20:52:48.565663 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.890209 (+1324546us) service_pool.cc:225] Handling call
1215 20:52:49.904446 (+ 14237us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.905825 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.907506 1721 raft_consensus.cc:2368] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 4.
I20251215 20:52:49.908010 1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 839) took 1343 ms. Trace:
I20251215 20:52:49.892673 2969 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:49.908402 1721 rpcz_store.cc:276] 1215 20:52:48.564866 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.890142 (+1325276us) service_pool.cc:225] Handling call
1215 20:52:49.907947 (+ 17805us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":92672}
I20251215 20:52:49.871845 1643 rpcz_store.cc:276] 1215 20:52:48.503720 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.734188 (+1230468us) service_pool.cc:225] Handling call
1215 20:52:49.740458 (+ 6270us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.763231 (+ 22773us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.775197 (+ 11966us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.893534 2911 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:49.911348 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.910513 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.914539 1721 raft_consensus.cc:2393] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:49.914394 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.913254 1716 raft_consensus.cc:2376] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
I20251215 20:52:49.915607 1720 raft_consensus.cc:2376] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
I20251215 20:52:49.917129 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 860) took 1175 ms. Trace:
I20251215 20:52:49.909757 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.909539 1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 696) took 1156 ms. Trace:
I20251215 20:52:49.918244 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.913632 2911 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:49.889331 1713 rpcz_store.cc:276] 1215 20:52:48.477845 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.663748 (+1185903us) service_pool.cc:225] Handling call
1215 20:52:49.737037 (+ 73289us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:49.869629 (+132592us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19126016}
I20251215 20:52:49.912892 2969 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:49.921849 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.924465 1715 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:49.925870 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:49.918422 1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34150 (request call id 694) took 1168 ms. Trace:
I20251215 20:52:49.932965 1721 rpcz_store.cc:276] 1215 20:52:48.750491 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.910231 (+1159740us) service_pool.cc:225] Handling call
1215 20:52:49.918360 (+ 8129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.925243 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 815) took 1542 ms. Trace:
I20251215 20:52:49.918907 1720 rpcz_store.cc:276] 1215 20:52:48.741010 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.906894 (+1165884us) service_pool.cc:225] Handling call
1215 20:52:49.916825 (+ 9931us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.918288 1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1018) took 2002 ms. Trace:
I20251215 20:52:49.920820 1712 rpcz_store.cc:276] 1215 20:52:48.752774 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.870308 (+1117534us) service_pool.cc:225] Handling call
1215 20:52:49.909282 (+ 38974us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.932571 1719 raft_consensus.cc:2376] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
I20251215 20:52:49.938405 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 859) took 1197 ms. Trace:
I20251215 20:52:49.939633 1719 rpcz_store.cc:276] 1215 20:52:48.740649 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.905462 (+1164813us) service_pool.cc:225] Handling call
1215 20:52:49.938329 (+ 32867us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16768}
I20251215 20:52:49.931416 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.941764 1717 raft_consensus.cc:2376] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
I20251215 20:52:49.935293 1639 rpcz_store.cc:276] 1215 20:52:47.915917 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.635631 (+1719714us) service_pool.cc:225] Handling call
1215 20:52:49.644882 (+ 9251us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.917789 (+272907us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.917828 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:49.917879 (+ 51us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:49.917914 (+ 35us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.918066 (+ 152us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.918216 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":18020,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":272410,"threads_started":1}
I20251215 20:52:49.926400 1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 857) took 1239 ms. Trace:
I20251215 20:52:49.943784 1716 rpcz_store.cc:276] 1215 20:52:48.687423 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.891516 (+1204093us) service_pool.cc:225] Handling call
1215 20:52:49.926328 (+ 34812us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.934165 1718 rpcz_store.cc:276] 1215 20:52:48.382595 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.912855 (+1530260us) service_pool.cc:225] Handling call
1215 20:52:49.925179 (+ 12324us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.942674 1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 840) took 1377 ms. Trace:
I20251215 20:52:49.930163 3002 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:49.946779 2897 raft_consensus.cc:2749] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20251215 20:52:49.945861 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.947016 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.933465 1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 855) took 1305 ms. Trace:
I20251215 20:52:49.947489 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.931035 1714 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:49.950071 1718 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:49.945716 1717 rpcz_store.cc:276] 1215 20:52:48.565154 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.894283 (+1329129us) service_pool.cc:225] Handling call
1215 20:52:49.942294 (+ 48011us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.948577 1716 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 1.
I20251215 20:52:49.950606 1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 856) took 1277 ms. Trace:
I20251215 20:52:49.952337 1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 827) took 1565 ms. Trace:
I20251215 20:52:49.953716 1716 rpcz_store.cc:276] 1215 20:52:48.386570 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.944693 (+1558123us) service_pool.cc:225] Handling call
1215 20:52:49.952228 (+ 7535us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.945780 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.960683 1717 raft_consensus.cc:1275] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:49.966730 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.967725 1720 raft_consensus.cc:2368] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3.
I20251215 20:52:49.968215 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 849) took 1400 ms. Trace:
I20251215 20:52:49.968595 1720 rpcz_store.cc:276] 1215 20:52:48.567520 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.934750 (+1367230us) service_pool.cc:225] Handling call
1215 20:52:49.963578 (+ 28828us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:49.966598 (+ 3020us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fdec 00007f30bac0f9ab 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:49.968155 (+ 1557us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":34803968}
I20251215 20:52:49.969614 1713 raft_consensus.cc:2468] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:49.952173 2969 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:49.986100 1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 786) took 2081 ms. Trace:
I20251215 20:52:49.974339 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.986675 1717 rpcz_store.cc:276] 1215 20:52:47.885367 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.959989 (+2074622us) service_pool.cc:225] Handling call
1215 20:52:49.960371 (+ 382us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.966385 (+ 6014us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.966593 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:49.973790 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 896830us
I20251215 20:52:49.987670 1718 raft_consensus.cc:1275] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20251215 20:52:49.976775 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 282457us
I20251215 20:52:49.988346 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 794) took 2100 ms. Trace:
W20251215 20:52:49.977825 1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.973207 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:49.986950 1721 raft_consensus.cc:2376] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
W20251215 20:52:49.978206 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 369439us
W20251215 20:52:49.989028 1612 connection.cc:232] RPC call timeout handler was delayed by -1.7433238520000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20251215 20:52:49.990621 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.992805 1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34136 (request call id 850) took 1425 ms. Trace:
I20251215 20:52:49.989537 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:49.994633 2258 leader_election.cc:336] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.163s (SENT)
I20251215 20:52:49.995241 2258 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:49.988664 1718 rpcz_store.cc:276] 1215 20:52:47.887978 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.961274 (+2073296us) service_pool.cc:225] Handling call
1215 20:52:49.987361 (+ 26087us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.988039 (+ 678us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.988242 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.994043 1721 rpcz_store.cc:276] 1215 20:52:48.567775 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.934890 (+1367115us) service_pool.cc:225] Handling call
1215 20:52:49.963117 (+ 28227us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:49.974169 (+ 11052us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fdec 00007f30bac0f9ab 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:49.992722 (+ 18553us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54185984}
W20251215 20:52:49.997977 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:49.998375 1721 raft_consensus.cc:1240] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:49.996575 1720 raft_consensus.cc:1275] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:49.996156 2760 raft_consensus.cc:2749] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:49.996275 1719 raft_consensus.cc:1275] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:49.999203 1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 693) took 1419 ms. Trace:
I20251215 20:52:49.992039 1686 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:50.010582 2997 raft_consensus.cc:2804] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:50.011104 2997 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:50.011487 2997 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.012080 1787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46054 (request call id 706) took 1260 ms. Trace:
I20251215 20:52:50.012730 1787 rpcz_store.cc:276] 1215 20:52:48.751444 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.763632 (+ 12188us) service_pool.cc:225] Handling call
1215 20:52:50.011871 (+1248239us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540019fd54. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:50.012016 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1131749632}
W20251215 20:52:50.014372 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.014889 1686 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:50.004235 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.015763 1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 810) took 1912 ms. Trace:
W20251215 20:52:49.992841 1612 connection.cc:232] RPC call timeout handler was delayed by -1.7109238519999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20251215 20:52:50.016268 1721 rpcz_store.cc:276] 1215 20:52:48.579787 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.997823 (+1418036us) service_pool.cc:225] Handling call
1215 20:52:49.998142 (+ 319us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.998922 (+ 780us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.999145 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:50.020133 2997 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.000305 2760 consensus_queue.cc:1048] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20251215 20:52:50.022491 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 863) took 1280 ms. Trace:
I20251215 20:52:50.023079 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 796) took 2133 ms. Trace:
I20251215 20:52:50.036548 1717 raft_consensus.cc:1275] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:50.036792 1720 rpcz_store.cc:276] 1215 20:52:47.889233 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.975471 (+2086238us) service_pool.cc:225] Handling call
1215 20:52:49.993967 (+ 18496us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:50.010178 (+ 16211us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.023020 (+ 12842us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.986505 2315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53414 (request call id 136) took 1530 ms. Trace:
I20251215 20:52:49.951987 1714 rpcz_store.cc:276] 1215 20:52:48.672987 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.883173 (+1210186us) service_pool.cc:225] Handling call
1215 20:52:49.921685 (+ 38512us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cb0bd0 00007f30c2cb04b4 00007f30bc240834 00007f30bc2407c2
1215 20:52:49.950518 (+ 28833us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4372352}
W20251215 20:52:49.991232 1761 leader_election.cc:336] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.563s (SENT)
W20251215 20:52:50.042189 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 50994.8us
W20251215 20:52:50.043140 1761 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.576s (SENT)
I20251215 20:52:50.043773 1761 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:50.046002 2868 raft_consensus.cc:2749] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:50.046483 1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:43794 (request call id 540) took 1445 ms. Trace:
W20251215 20:52:50.045452 1761 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.754s (SENT)
I20251215 20:52:50.047642 1761 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:50.048851 2735 raft_consensus.cc:2749] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:52:50.049299 1761 leader_election.cc:336] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.764s (SENT)
I20251215 20:52:50.051189 1609 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
W20251215 20:52:50.051473 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.023378 2258 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:50.032343 1719 rpcz_store.cc:276] 1215 20:52:48.103428 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.995375 (+1891947us) service_pool.cc:225] Handling call
1215 20:52:49.995947 (+ 572us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:50.015499 (+ 19552us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.015711 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 20:52:50.032866 1612 connection.cc:232] RPC call timeout handler was delayed by -1.6695238519999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20251215 20:52:50.052429 1612 connection.cc:232] RPC call timeout handler was delayed by -1.637123852000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20251215 20:52:50.052829 1612 connection.cc:232] RPC call timeout handler was delayed by -1.5255238519999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20251215 20:52:50.053145 1612 connection.cc:232] RPC call timeout handler was delayed by -1.3707907859999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20251215 20:52:50.053440 1612 connection.cc:232] RPC call timeout handler was delayed by -1.1988238520000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
W20251215 20:52:50.053750 1612 connection.cc:232] RPC call timeout handler was delayed by -1.1898238519999893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20251215 20:52:50.054163 1612 connection.cc:232] RPC call timeout handler was delayed by -1.1835238519999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20251215 20:52:50.054502 1612 connection.cc:232] RPC call timeout handler was delayed by -1.0264395130000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20251215 20:52:50.009783 1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1020) took 2045 ms. Trace:
I20251215 20:52:50.053670 1686 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:50.024312 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 402383us
I20251215 20:52:50.039997 1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 809) took 1962 ms. Trace:
I20251215 20:52:50.059502 1717 rpcz_store.cc:276] 1215 20:52:48.077185 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:50.025002 (+1947817us) service_pool.cc:225] Handling call
1215 20:52:50.035962 (+ 10960us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:50.039693 (+ 3731us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.039926 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:49.949565 1715 rpcz_store.cc:276] 1215 20:52:48.626461 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.881978 (+1255517us) service_pool.cc:225] Handling call
1215 20:52:49.932153 (+ 50175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:50.028615 1716 raft_consensus.cc:1275] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:50.062026 1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 787) took 2176 ms. Trace:
I20251215 20:52:50.027457 3006 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:50.036583 1718 rpcz_store.cc:276] 1215 20:52:48.741858 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.999241 (+1257383us) service_pool.cc:225] Handling call
1215 20:52:50.021251 (+ 22010us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:50.021860 (+ 609us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:50.021912 (+ 52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:50.022029 (+ 117us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:50.022063 (+ 34us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.022190 (+ 127us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:50.022376 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99}
I20251215 20:52:50.062496 1716 rpcz_store.cc:276] 1215 20:52:47.885751 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.964236 (+2078485us) service_pool.cc:225] Handling call
1215 20:52:50.028203 (+ 63967us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:50.061730 (+ 33527us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.061962 (+ 232us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 20:52:50.035982 2679 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
W20251215 20:52:50.071235 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 481204us
I20251215 20:52:50.074288 1612 leader_election.cc:400] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Vote denied by peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401) with higher term. Message: Invalid argument: T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:50.074848 1612 leader_election.cc:403] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20251215 20:52:50.066700 1761 leader_election.cc:336] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.787s (SENT)
I20251215 20:52:50.066989 1719 raft_consensus.cc:1240] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: [2.3-2.3]
W20251215 20:52:50.067346 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.081569 1761 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:50.082943 1718 raft_consensus.cc:1240] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
W20251215 20:52:50.083272 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.086768 2775 raft_consensus.cc:2804] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:50.087060 1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1004) took 2775 ms. Trace:
W20251215 20:52:50.087481 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.088418 2967 raft_consensus.cc:2749] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:50.091221 1641 rpcz_store.cc:276] 1215 20:52:47.311762 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.535683 (+2223921us) service_pool.cc:225] Handling call
1215 20:52:49.535991 (+ 308us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.536199 (+ 208us) raft_consensus.cc:1534] Early marking committed up to index 5
1215 20:52:49.979019 (+442820us) log.cc:844] Serialized 14 byte log entry
1215 20:52:50.086314 (+107295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:50.086439 (+ 125us) raft_consensus.cc:1645] Marking committed up to 5
1215 20:52:50.086517 (+ 78us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.086665 (+ 148us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:50.086938 (+ 273us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":382723,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":180,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"thread_start_us":502992,"threads_started":2}
W20251215 20:52:50.096419 1761 leader_election.cc:336] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.795s (SENT)
W20251215 20:52:50.101305 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:50.101964 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.104732 2735 consensus_queue.cc:1059] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251215 20:52:50.106238 2735 raft_consensus.cc:3055] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:50.106698 2735 raft_consensus.cc:740] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
W20251215 20:52:50.104398 1761 leader_election.cc:336] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.810s (SENT)
I20251215 20:52:50.041330 2935 consensus_queue.cc:1059] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20251215 20:52:50.112236 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 48593.6us
I20251215 20:52:50.079496 2940 raft_consensus.cc:2749] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401) with higher term. Message: Invalid argument: T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:50.114879 1612 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:50.114996 1761 leader_election.cc:336] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.841s (SENT)
I20251215 20:52:50.116273 1761 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:50.117511 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.107693 2735 consensus_queue.cc:260] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:50.146731 3020 log.cc:927] Time spent T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.085s user 0.000s sys 0.000s
W20251215 20:52:50.148895 1761 leader_election.cc:336] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.899s (SENT)
I20251215 20:52:50.151542 1761 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:50.155611 2679 raft_consensus.cc:697] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:50.156718 2679 consensus_queue.cc:237] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.047005 1642 rpcz_store.cc:276] 1215 20:52:48.601175 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.790674 (+1189499us) service_pool.cc:225] Handling call
1215 20:52:50.045916 (+255242us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400325854. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc650c0 00007f30bdd03bba 00007f30c2cb458e 00007f30bc253437 00007f30bc2533c2 00007f30bc2532f1 00007f30bc25326c 00007f30bc252522 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:50.046402 (+ 486us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":248389888}
W20251215 20:52:50.168833 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 54021.5us
W20251215 20:52:50.078328 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:50.176889 1761 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.979s (SENT)
W20251215 20:52:50.177860 1761 leader_election.cc:336] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.007s (SENT)
I20251215 20:52:50.178242 1761 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:50.102861 2868 consensus_queue.cc:1059] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20251215 20:52:50.181586 1612 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:50.182977 1612 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:50.185469 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.186981 1612 leader_election.cc:400] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Vote denied by peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401) with higher term. Message: Invalid argument: T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4.
I20251215 20:52:50.188687 1612 leader_election.cc:403] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20251215 20:52:50.180437 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 121606us
I20251215 20:52:50.150233 1713 raft_consensus.cc:1240] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20251215 20:52:50.200598 1761 leader_election.cc:336] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.061s (SENT)
I20251215 20:52:50.168274 3007 raft_consensus.cc:2749] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:50.203837 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:50.201552 3016 raft_consensus.cc:2804] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
W20251215 20:52:50.176187 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 101091us
I20251215 20:52:50.201764 2999 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:50.198787 2861 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:50.198963 2940 raft_consensus.cc:2749] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:50.058053 1638 rpcz_store.cc:276] 1215 20:52:47.968893 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.669618 (+1700725us) service_pool.cc:225] Handling call
1215 20:52:49.669970 (+ 352us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.670171 (+ 201us) raft_consensus.cc:1534] Early marking committed up to index 4
1215 20:52:49.982275 (+312104us) log.cc:844] Serialized 14 byte log entry
1215 20:52:50.009350 (+ 27075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:50.009413 (+ 63us) raft_consensus.cc:1645] Marking committed up to 4
1215 20:52:50.009467 (+ 54us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.009553 (+ 86us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:50.009714 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1566,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":139,"thread_start_us":24760,"threads_started":1,"wal-append.queue_time_us":55335}
I20251215 20:52:50.199860 2735 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.078102 3006 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:50.207305 3019 log.cc:927] Time spent T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
W20251215 20:52:50.074585 2860 raft_consensus.cc:2771] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 LEARNER]: Leader pre-election decision while not in active config. Result: Term 3: won. RaftConfig: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:50.355803 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.356639 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:50.357254 1758 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:50.202732 1714 raft_consensus.cc:1240] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:50.359941 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 154774us
I20251215 20:52:50.198697 3000 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:50.203907 2967 raft_consensus.cc:2749] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:50.204352 2897 raft_consensus.cc:2749] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:50.364008 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 177155us
I20251215 20:52:50.367473 1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1006) took 3055 ms. Trace:
I20251215 20:52:50.404874 1646 rpcz_store.cc:276] 1215 20:52:47.312389 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.546917 (+2234528us) service_pool.cc:225] Handling call
1215 20:52:49.586524 (+ 39607us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.684733 (+ 98209us) raft_consensus.cc:1534] Early marking committed up to index 5
1215 20:52:50.032157 (+347424us) log.cc:844] Serialized 14 byte log entry
1215 20:52:50.173679 (+141522us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:50.173741 (+ 62us) raft_consensus.cc:1645] Marking committed up to 5
1215 20:52:50.173786 (+ 45us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.367265 (+193479us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b5400185454. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfba81 00007f30bdcfa4be 00007f30c2caef49 00007f30bc23bd34 00007f30bc23bcc2 00007f30bc23bbf1 00007f30bc23bb6c 00007f30bc23ae22 00007f30bc03a55c 00007f30bc039996
1215 20:52:50.367304 (+ 39us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:50.367425 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":117216,"prepare.queue_time_us":260780,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":57960,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":23121,"spinlock_wait_cycles":225235200,"thread_start_us":418010,"threads_started":2}
I20251215 20:52:50.202477 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:50.268110 3016 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:50.406986 3016 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.277783 2311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:50.355504 2818 raft_consensus.cc:2749] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401) with higher term. Message: Invalid argument: T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4.
I20251215 20:52:50.362896 3002 raft_consensus.cc:3055] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:50.410610 1758 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:50.041561 2315 rpcz_store.cc:276] 1215 20:52:48.449324 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:48.458358 (+ 9034us) service_pool.cc:225] Handling call
1215 20:52:48.510057 (+ 51699us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:49.652339 (+1142282us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:49.652377 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:49.672006 (+ 19629us) log.cc:844] Serialized 26 byte log entry
1215 20:52:49.915308 (+243302us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:49.916093 (+ 785us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:49.920974 (+ 4881us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:49.948765 (+ 27791us) raft_consensus.cc:1685] finished
1215 20:52:49.955283 (+ 6518us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:49.964395 (+ 9112us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":229471,"threads_started":1,"wal-append.queue_time_us":253712}
I20251215 20:52:50.392272 2806 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:50.377784 2999 raft_consensus.cc:697] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:50.402609 3007 raft_consensus.cc:2749] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251215 20:52:50.428558 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:50.513197 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.434718 2993 raft_consensus.cc:2749] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:50.407132 2319 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:50.372841 3015 raft_consensus.cc:2804] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:50.432999 3002 raft_consensus.cc:740] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
W20251215 20:52:50.390920 2257 leader_election.cc:336] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:50.384159 2868 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:50.509558 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 70501.1us
I20251215 20:52:50.374102 2861 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.515760 2818 consensus_queue.cc:1059] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:50.416780 3000 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:50.517055 3017 log.cc:927] Time spent T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.348s user 0.000s sys 0.001s
W20251215 20:52:50.517766 3014 log.cc:927] Time spent T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.147s user 0.000s sys 0.000s
W20251215 20:52:50.525893 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.416765 2997 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:50.566557 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:50.533598 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:50.567345 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.526809 3015 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:50.555068 1795 raft_consensus.cc:1240] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:50.556051 1793 raft_consensus.cc:1240] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:50.560245 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:50.534610 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 266160us
I20251215 20:52:50.518024 2806 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.589989 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.590378 1789 raft_consensus.cc:1240] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 3. Ops: []
I20251215 20:52:50.590900 1792 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:50.592376 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:50.598464 1530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 388165us
I20251215 20:52:50.598642 2935 consensus_queue.cc:1048] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:50.600723 3028 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:50.601322 3028 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.603506 3028 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.605412 2861 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.607332 2973 raft_consensus.cc:1064] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:50.607828 2973 raft_consensus.cc:1068] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
I20251215 20:52:50.583066 3015 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.613406 1786 raft_consensus.cc:1275] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20251215 20:52:50.534904 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 151124us
I20251215 20:52:50.618197 1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43814 (request call id 1000) took 3307 ms. Trace:
I20251215 20:52:50.620685 1645 rpcz_store.cc:276] 1215 20:52:47.310577 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:49.529324 (+2218747us) service_pool.cc:225] Handling call
1215 20:52:49.579330 (+ 50006us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:49.579573 (+ 243us) raft_consensus.cc:1534] Early marking committed up to index 2
1215 20:52:50.080600 (+501027us) log.cc:844] Serialized 14 byte log entry
1215 20:52:50.617813 (+537213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:50.617875 (+ 62us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:50.617923 (+ 48us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.618004 (+ 81us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:50.618128 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3305,"prepare.queue_time_us":351369,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":142982,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":15313,"thread_start_us":1024167,"threads_started":3}
I20251215 20:52:50.540477 2868 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.546862 2993 consensus_queue.cc:1048] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20251215 20:52:50.632929 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.633846 1790 raft_consensus.cc:2393] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:50.631826 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.638638 1795 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.596086 2852 raft_consensus.cc:3055] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:50.641163 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:50.642755 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 268006us
I20251215 20:52:50.645627 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.646293 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.647142 1793 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:50.647907 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.648531 1789 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.650081 1788 raft_consensus.cc:1275] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251215 20:52:50.581357 3004 consensus_queue.cc:1048] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
W20251215 20:52:50.629545 1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s user 0.007s sys 0.005s
W20251215 20:52:50.654109 1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s user 0.008s sys 0.006s
I20251215 20:52:50.595739 2897 consensus_queue.cc:1048] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20251215 20:52:50.651911 1684 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:50.655910 1795 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.660480 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.661761 1795 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.643703 2852 raft_consensus.cc:740] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:50.655423 2861 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:50.664175 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.658246 3026 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:50.666790 1721 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:50.667266 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:50.671672 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.672171 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.674379 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.675418 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:50.676187 1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.676388 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.676173 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.678869 1721 raft_consensus.cc:1240] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer fbfdeb011a604f78a77f04be26573717 for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:50.619810 2999 consensus_queue.cc:237] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.683524 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.684123 1788 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.664345 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.685977 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.696682 2313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:50.696977 1786 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:50.697444 1793 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:50.699242 2911 consensus_meta.cc:287] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Time spent flushing consensus metadata: real 0.771s user 0.005s sys 0.005s
W20251215 20:52:50.700897 3037 log.cc:927] Time spent T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20251215 20:52:50.621874 3002 consensus_queue.cc:260] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.701884 3015 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.703898 3015 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.704598 1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 701) took 1121 ms. Trace:
I20251215 20:52:50.704833 1793 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.709791 2868 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:50.688853 3000 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.710549 2775 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:50.689442 3026 raft_consensus.cc:697] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:50.711037 2775 raft_consensus.cc:3060] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:50.680915 3006 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.690882 1789 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.691582 2852 consensus_queue.cc:260] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.692716 3030 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:50.713778 3030 raft_consensus.cc:1068] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
I20251215 20:52:50.695338 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:50.672323 2861 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.719367 2861 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.721823 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.696168 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:50.687265 1795 raft_consensus.cc:2410] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20251215 20:52:50.723639 3024 log.cc:927] Time spent T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.081s user 0.003s sys 0.000s
W20251215 20:52:50.724248 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.725052 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.725728 1715 raft_consensus.cc:2468] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 1.
I20251215 20:52:50.727255 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:50.730367 1592 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:50.730822 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:50.734875 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.742636 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.743526 1716 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:50.743914 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:50.711197 1720 rpcz_store.cc:276] 1215 20:52:49.583306 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:50.040996 (+457690us) service_pool.cc:225] Handling call
1215 20:52:50.071902 (+ 30906us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:50.127377 (+ 55475us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:50.148948 (+ 21571us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:50.174499 (+ 25551us) log.cc:844] Serialized 26 byte log entry
1215 20:52:50.409673 (+235174us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:50.409939 (+ 266us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:50.410096 (+ 157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:50.704366 (+294270us) raft_consensus.cc:1685] finished
1215 20:52:50.704388 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:50.704538 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3959,"raft.queue_time_us":296412,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":17407,"thread_start_us":174087,"threads_started":2,"wal-append.queue_time_us":368331}
I20251215 20:52:50.690599 2806 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.699723 2911 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:50.745898 2923 raft_consensus.cc:3055] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Stepping down as leader of term 2
W20251215 20:52:50.746336 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 140947us
W20251215 20:52:50.757790 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 230027us
W20251215 20:52:50.772426 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:50.773187 1760 leader_election.cc:336] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:50.780128 1788 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
W20251215 20:52:50.781464 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:50.785656 1760 leader_election.cc:336] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:50.789574 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:50.791245 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.791441 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.792100 1788 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
W20251215 20:52:50.793866 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:50.794643 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:50.757741 2923 raft_consensus.cc:740] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:50.805325 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:50.813510 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:50.798259 3042 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:50.818878 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.812635 2311 raft_consensus.cc:2368] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 3. Current term is 4.
W20251215 20:52:50.824533 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:50.833561 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.834386 1788 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.836738 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.836969 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.837406 1795 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:50.837694 1789 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:50.838215 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.838371 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.838476 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.838807 1790 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:50.840066 1794 raft_consensus.cc:2410] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20251215 20:52:50.841081 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 434356us
I20251215 20:52:50.843067 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.843899 1793 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 1.
I20251215 20:52:50.844923 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.845564 1793 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:50.846563 1612 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:50.848251 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:50.849560 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.851945 1795 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
W20251215 20:52:50.853360 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 88575.1us
I20251215 20:52:50.854478 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.855473 1792 raft_consensus.cc:2393] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:50.858923 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.859838 1789 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:50.862913 1612 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:50.864326 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.865876 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.866513 1792 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.866976 2258 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:50.864457 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.869012 2258 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:50.871160 1794 raft_consensus.cc:2393] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:50.873291 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.874004 1789 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.875036 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.853046 3000 raft_consensus.cc:2804] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:50.876983 2258 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:50.876935 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.824884 3042 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:50.881734 1760 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:50.882424 1794 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:50.885771 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.878028 1793 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:50.886544 1791 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:50.887156 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.878415 3046 raft_consensus.cc:2749] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:50.885960 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.893926 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:50.894788 1686 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:50.895144 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.895954 1794 raft_consensus.cc:2393] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:50.888643 1793 raft_consensus.cc:2393] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:50.856454 2861 consensus_queue.cc:1048] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20251215 20:52:50.897557 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.883522 2999 raft_consensus.cc:2804] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:50.829921 2923 consensus_queue.cc:260] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:50.853415 3006 consensus_queue.cc:1059] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20251215 20:52:50.900182 1793 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
W20251215 20:52:50.902109 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:50.904855 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.905457 1795 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.902706 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.903764 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.906628 1788 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.863844 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.901404 2999 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:50.884008 2860 raft_consensus.cc:2804] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:50.829144 3026 consensus_queue.cc:237] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:50.951321 2860 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:50.951903 2860 raft_consensus.cc:3060] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:50.953290 3042 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.866048 2973 consensus_queue.cc:1048] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20251215 20:52:50.938076 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.959739 1791 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
I20251215 20:52:50.889765 3000 raft_consensus.cc:697] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:50.888270 2987 consensus_queue.cc:1059] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
W20251215 20:52:50.940150 3016 consensus_meta.cc:287] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.532s user 0.006s sys 0.006s
I20251215 20:52:50.977560 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.978351 1791 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:50.936487 2999 raft_consensus.cc:3060] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:50.921965 1794 raft_consensus.cc:1240] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:50.981660 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.982805 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.983891 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.984504 1794 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.901619 2911 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:50.944325 1788 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
W20251215 20:52:50.945485 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.962370 1792 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.986647 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.987253 1792 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.938630 1793 raft_consensus.cc:1275] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20251215 20:52:50.951179 3049 log.cc:927] Time spent T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.062s user 0.000s sys 0.001s
I20251215 20:52:50.939359 1795 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.901322 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.988953 1787 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:50.989230 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:50.989916 1793 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:50.990804 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:50.991348 1793 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:50.992034 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:50.976819 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 95188.3us
I20251215 20:52:50.994500 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:50.976956 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:50.999833 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.000701 1719 raft_consensus.cc:2393] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:51.002411 1792 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:51.009547 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.011981 1788 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:51.015211 1793 raft_consensus.cc:2468] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:51.016108 1791 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:51.017038 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:51.018008 1794 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 4
I20251215 20:52:51.018532 1791 raft_consensus.cc:1275] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:51.021651 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:51.022914 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.023550 1719 raft_consensus.cc:2376] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3. Re-sending same reply.
I20251215 20:52:51.025507 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:51.026594 1761 connection.cc:232] RPC call timeout handler was delayed by -1.317826330000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3215s for a response
W20251215 20:52:51.027330 1761 leader_election.cc:336] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.700s (SENT)
I20251215 20:52:51.030272 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.031188 1718 raft_consensus.cc:2393] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:51.031723 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:51.032541 1716 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fbfdeb011a604f78a77f04be26573717 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:51.042580 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:51.044642 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 177926us
I20251215 20:52:51.046006 1612 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:51.047049 1612 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:51.048744 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:51.028194 1761 leader_election.cc:336] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.728s (SENT)
I20251215 20:52:51.050521 1761 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:51.052677 1761 connection.cc:232] RPC call timeout handler was delayed by -1.1600342890000377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.294s for a response
W20251215 20:52:51.053102 1761 connection.cc:232] RPC call timeout handler was delayed by -1.1537342890000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2947s for a response
W20251215 20:52:51.054769 1761 leader_election.cc:336] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 1.996s (SENT)
I20251215 20:52:51.055162 1761 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.060768 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.061952 1719 raft_consensus.cc:2393] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:51.067714 1612 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:51.068743 1761 leader_election.cc:336] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.057s (SENT)
W20251215 20:52:51.069705 1761 leader_election.cc:336] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.103s (SENT)
W20251215 20:52:51.071098 1761 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.111s (SENT)
I20251215 20:52:51.071626 1761 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.074699 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.081753 1687 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:51.083679 1687 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:51.073405 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.085215 1719 raft_consensus.cc:2393] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:51.086459 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.086515 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.024524 3006 raft_consensus.cc:3055] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:51.090601 1687 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:51.073738 3008 raft_consensus.cc:2749] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:51.079207 2993 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.107714 1687 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:51.108664 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:51.104440 1761 leader_election.cc:336] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.115s (SENT)
I20251215 20:52:51.110291 1761 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.020278 2775 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:51.116223 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:51.119915 1687 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:51.117623 1761 leader_election.cc:336] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.131s (SENT)
I20251215 20:52:51.090390 3015 raft_consensus.cc:2749] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.096968 3038 raft_consensus.cc:2804] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:51.093463 2923 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.090267 3006 raft_consensus.cc:740] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:51.090551 2679 consensus_queue.cc:1048] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20251215 20:52:51.090732 3031 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20251215 20:52:51.117445 2973 raft_consensus.cc:2804] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:51.131861 2973 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:51.132364 2973 raft_consensus.cc:3060] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:51.094463 2315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:51.121284 1687 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:51.122152 1761 leader_election.cc:336] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.131s (SENT)
I20251215 20:52:51.102121 2861 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election won for term 5
W20251215 20:52:51.139662 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 121889us
I20251215 20:52:51.099754 2967 raft_consensus.cc:2749] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20251215 20:52:51.140887 1761 leader_election.cc:336] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.147s (SENT)
I20251215 20:52:51.141337 1761 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.017489 3016 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:51.142350 1761 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.166s (SENT)
W20251215 20:52:51.123703 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:51.143165 1761 leader_election.cc:336] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.193s (SENT)
I20251215 20:52:51.099352 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:51.122869 2735 raft_consensus.cc:2749] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.143575 1761 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.106528 3044 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:51.087513 2806 consensus_queue.cc:1059] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20251215 20:52:51.140486 2861 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:51.096872 3028 raft_consensus.cc:2804] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:51.125267 3038 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:51.117278 3004 raft_consensus.cc:2749] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:51.187718 3015 raft_consensus.cc:2749] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.124670 3039 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:51.188627 3039 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:51.189072 3039 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.109558 3000 consensus_queue.cc:237] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.184188 3028 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:51.190663 3028 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.145937 3044 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:51.192796 3044 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:51.187568 3038 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:51.179539 2897 raft_consensus.cc:2749] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.199167 2860 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:51.201683 2775 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:51.184676 2861 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:51.202550 3038 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:51.145349 1761 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.194s (SENT)
W20251215 20:52:51.168972 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:51.205248 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 60402.1us
I20251215 20:52:51.180656 1717 raft_consensus.cc:1275] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:51.177568 1788 raft_consensus.cc:1275] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20251215 20:52:51.145510 2258 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:51.209368 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:51.119369 1794 raft_consensus.cc:2468] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 4.
W20251215 20:52:51.177261 3066 log.cc:927] Time spent T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
I20251215 20:52:51.175328 2852 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:51.147970 2735 raft_consensus.cc:2749] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:52:51.209437 1761 leader_election.cc:336] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.385s (SENT)
I20251215 20:52:51.218859 1761 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:51.210367 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 64940.3us
W20251215 20:52:51.186635 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 65421.3us
I20251215 20:52:51.201488 3044 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.178167 1787 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
W20251215 20:52:51.220535 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 152881us
W20251215 20:52:51.221617 1761 leader_election.cc:336] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.450s (SENT)
I20251215 20:52:51.222527 1612 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:51.223531 1612 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: fbfdeb011a604f78a77f04be26573717
I20251215 20:52:51.227072 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:51.228616 1761 leader_election.cc:336] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.500s (SENT)
I20251215 20:52:51.212579 2775 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.232343 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.233109 1761 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.234027 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:51.259785 1788 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.260308 1721 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.236263 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:51.238410 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.241189 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.212771 2760 raft_consensus.cc:2749] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251215 20:52:51.265487 1761 leader_election.cc:336] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.526s (SENT)
I20251215 20:52:51.265990 1761 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:51.267010 1761 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Timed out: RequestConsensusVote RPC to 127.0.106.130:37421 timed out after 2.754s (SENT)
I20251215 20:52:51.267174 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.269058 1761 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.269518 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:51.270778 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.270933 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.271481 1795 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.271965 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.229414 3000 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:51.272970 3000 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:51.273336 3000 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.273756 3038 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:51.274634 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.275344 1787 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.275523 2967 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.277386 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.280005 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:51.280827 1788 raft_consensus.cc:2368] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
W20251215 20:52:51.285064 1612 connection.cc:232] RPC call timeout handler was delayed by -1.2943678240000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20251215 20:52:51.285672 1612 connection.cc:232] RPC call timeout handler was delayed by -1.0072678239999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
I20251215 20:52:51.272325 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.292487 3047 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.292826 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.293000 2775 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:51.293494 1786 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:51.295830 2775 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:51.296870 1712 raft_consensus.cc:1240] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20251215 20:52:51.297299 3000 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.297716 1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 706) took 1704 ms. Trace:
I20251215 20:52:51.298171 1712 rpcz_store.cc:276] 1215 20:52:49.593439 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:50.069713 (+476274us) service_pool.cc:225] Handling call
1215 20:52:50.717066 (+647353us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0fe3e 000000000035a3c9 00007f30c2c3a560 00007f30c2d02dd4 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:51.225702 (+508636us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fedc 00007f30bac0fe46 000000000035a3c9 00007f30c2c3a560 00007f30c2d02dd4 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:51.258712 (+ 33010us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:51.297401 (+ 38689us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:51.297654 (+ 253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":121603328}
I20251215 20:52:51.219533 2860 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:51.310953 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 43961.6us
I20251215 20:52:51.314882 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.315773 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.316004 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.316499 1795 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.316553 1791 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.318234 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:51.318868 1788 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.229825 3058 raft_consensus.cc:2804] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:51.189985 3006 consensus_queue.cc:260] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:51.320418 1686 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:51.259264 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:51.324625 1686 leader_election.cc:336] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:51.325255 1686 leader_election.cc:336] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:51.326040 1686 leader_election.cc:336] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:51.326607 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.325198 1794 raft_consensus.cc:1240] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:51.320535 1612 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
W20251215 20:52:51.329778 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.264240 3072 raft_consensus.cc:2749] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:52:51.330441 1686 leader_election.cc:336] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:51.331239 1790 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.332541 1612 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.299681 3000 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:51.335614 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:51.313030 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.323114 3058 raft_consensus.cc:493] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
W20251215 20:52:51.340595 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.336453 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:51.329335 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 103212us
I20251215 20:52:51.343590 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:51.522020 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:51.476941 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:51.517220 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 176666us
I20251215 20:52:51.393744 1721 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.402769 1793 raft_consensus.cc:1275] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:51.408728 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:51.532460 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 199917us
W20251215 20:52:51.418632 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:51.445526 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:51.366917 1792 raft_consensus.cc:1275] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:51.341941 1761 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.421365 2258 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:51.512878 1542 catalog_manager.cc:5654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 2 to 3, term changed from 1 to 3, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to <none>, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:51.594098 1720 raft_consensus.cc:2468] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
W20251215 20:52:51.594413 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 252514us
I20251215 20:52:51.595144 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:51.593179 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:51.595461 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:51.596010 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:51.596484 1686 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.596617 1720 raft_consensus.cc:2393] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
W20251215 20:52:51.597064 1686 leader_election.cc:336] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:51.597515 1761 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:51.597819 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 176548us
I20251215 20:52:51.593132 1718 raft_consensus.cc:3060] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:51.600476 1612 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:51.339170 2775 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.333458 3073 raft_consensus.cc:2749] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.337620 3043 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.372957 2897 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.602641 1761 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:51.491273 2940 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.595798 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:51.618201 1721 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.341146 3075 raft_consensus.cc:2804] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
W20251215 20:52:51.604939 1758 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:51.414566 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.396046 3035 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:51.361603 3030 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:51.597704 1686 leader_election.cc:336] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:51.594969 1542 catalog_manager.cc:5654] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 2 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
W20251215 20:52:51.625553 1686 consensus_peers.cc:597] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.372414 3002 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.378072 1787 raft_consensus.cc:1240] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: []
I20251215 20:52:51.597395 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.644567 1720 raft_consensus.cc:2468] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
W20251215 20:52:51.645584 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:51.646397 1686 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.382704 3039 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.364534 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.654146 1713 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.655206 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.655862 1713 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:51.367517 2311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53398 (request call id 118) took 1188 ms. Trace:
I20251215 20:52:51.657050 2311 rpcz_store.cc:276] 1215 20:52:50.179017 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:50.181102 (+ 2085us) service_pool.cc:225] Handling call
1215 20:52:51.367280 (+1186178us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54004b78d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:51.367449 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":877588352}
I20251215 20:52:51.658285 2315 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251215 20:52:51.517681 3058 raft_consensus.cc:3060] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:51.648118 3035 raft_consensus.cc:1068] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
I20251215 20:52:51.400228 2911 raft_consensus.cc:3055] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:51.662930 2911 raft_consensus.cc:740] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:51.663913 2911 consensus_queue.cc:260] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:51.665225 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.420675 2935 raft_consensus.cc:3055] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:51.616062 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:51.600613 1716 raft_consensus.cc:2468] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:51.666657 1717 raft_consensus.cc:2368] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:51.628880 3063 raft_consensus.cc:2804] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:51.667016 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.667479 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.611675 2775 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.409976 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.511337 1543 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45294 (request call id 184) took 4868 ms. Trace:
I20251215 20:52:51.377641 2861 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:51.593137 3000 raft_consensus.cc:2749] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.345850 1715 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.625064 1761 leader_election.cc:400] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3.
I20251215 20:52:51.605002 3008 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20251215 20:52:51.670415 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:51.383602 3044 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:51.380328 2999 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.645474 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:51.399852 3016 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:51.624423 1786 raft_consensus.cc:2393] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:51.373939 2973 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.650061 3051 consensus_queue.cc:1059] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20251215 20:52:51.650692 3069 raft_consensus.cc:2804] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:51.665503 2911 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.670464 1761 leader_election.cc:403] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20251215 20:52:51.672889 1718 raft_consensus.cc:2468] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:51.668848 1717 raft_consensus.cc:1240] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
W20251215 20:52:51.692420 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 76259.4us
I20251215 20:52:51.674273 1721 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.695801 1761 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:51.647033 1686 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:51.701601 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 54600.9us
I20251215 20:52:51.621984 3075 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:51.622807 2940 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.365235 3028 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.667404 3063 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:51.668892 1543 rpcz_store.cc:276] 1215 20:52:46.643135 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:46.643291 (+ 156us) service_pool.cc:225] Handling call
1215 20:52:51.511253 (+4867962us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:50.181086 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:50.518221 (+337135us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:50.518259 (+ 38us) write_op.cc:435] Acquired schema lock
1215 20:52:50.518275 (+ 16us) tablet.cc:660] Decoding operations
1215 20:52:50.519336 (+ 1061us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:50.519399 (+ 63us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:50.519452 (+ 53us) tablet.cc:683] Acquiring locks for 10 operations
1215 20:52:50.520242 (+ 790us) tablet.cc:699] Row locks acquired
1215 20:52:50.520260 (+ 18us) write_op.cc:260] PREPARE: finished
1215 20:52:50.531102 (+ 10842us) write_op.cc:270] Start()
1215 20:52:50.543925 (+ 12823us) write_op.cc:276] Timestamp: P: 1765831970528694 usec, L: 0
1215 20:52:50.543976 (+ 51us) op_driver.cc:348] REPLICATION: starting
1215 20:52:50.650960 (+106984us) log.cc:844] Serialized 4033 byte log entry
1215 20:52:51.126003 (+475043us) op_driver.cc:464] REPLICATION: finished
1215 20:52:51.341494 (+215491us) write_op.cc:301] APPLY: starting
1215 20:52:51.341580 (+ 86us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:51.341811 (+ 231us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:51.357714 (+ 15903us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:51.358833 (+ 1119us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:51.359087 (+ 254us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
1215 20:52:51.359138 (+ 51us) write_op.cc:312] APPLY: finished
1215 20:52:51.359466 (+ 328us) log.cc:844] Serialized 76 byte log entry
1215 20:52:51.360943 (+ 1477us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:51.363582 (+ 2639us) write_op.cc:454] Released schema lock
1215 20:52:51.363644 (+ 62us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:51.379359 (+ 15715us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:51.381010 (+ 1651us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85465,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":215198,"apply.run_cpu_time_us":3376,"apply.run_wall_time_us":37800,"num_ops":10,"prepare.queue_time_us":362079,"prepare.run_cpu_time_us":44891,"prepare.run_wall_time_us":657686,"raft.queue_time_us":134068,"raft.run_cpu_time_us":29495,"raft.run_wall_time_us":216007,"replication_time_us":566437,"thread_start_us":691484,"threads_started":4,"wal-append.queue_time_us":241168}]]}
I20251215 20:52:51.679198 1716 raft_consensus.cc:1240] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:51.679611 1720 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.625988 3007 raft_consensus.cc:2804] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251215 20:52:51.657059 3079 log.cc:927] Time spent T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20251215 20:52:51.666067 2935 raft_consensus.cc:740] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:51.666122 1712 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:51.626696 1542 catalog_manager.cc:5654] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 3 to 4, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:51.732069 1542 catalog_manager.cc:5654] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 2 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251215 20:52:51.643818 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.622584 2897 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:51.697098 2258 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:51.721545 1714 raft_consensus.cc:2393] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:51.702491 1686 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.617969 2818 consensus_queue.cc:1059] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20251215 20:52:51.710150 3075 raft_consensus.cc:3060] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:51.739739 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:51.691088 2806 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20251215 20:52:51.703316 2638 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for earlier term 2. Current term is 3.
I20251215 20:52:51.706079 3072 raft_consensus.cc:2804] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:51.709122 3069 raft_consensus.cc:697] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 4 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:51.737072 1542 catalog_manager.cc:5654] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 2 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:51.718689 3063 raft_consensus.cc:3060] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:51.707650 2993 consensus_queue.cc:1048] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20251215 20:52:51.718942 3007 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:51.741179 1761 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.717555 2868 consensus_queue.cc:1048] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20251215 20:52:51.729563 2852 raft_consensus.cc:3055] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:51.754918 1542 catalog_manager.cc:5654] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 2 to 4, term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130), fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251215 20:52:51.756903 1686 consensus_peers.cc:597] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.725072 3008 consensus_queue.cc:1048] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20251215 20:52:51.763926 1542 catalog_manager.cc:5654] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 2 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:51.766825 1542 catalog_manager.cc:5654] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:51.749164 2775 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:51.759918 3007 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:52:51.736469 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 93976.1us
I20251215 20:52:51.753302 2988 raft_consensus.cc:2804] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader election won for term 2
W20251215 20:52:51.769747 1686 leader_election.cc:336] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:51.769639 1542 catalog_manager.cc:5654] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:51.773159 1761 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:51.762995 2852 raft_consensus.cc:740] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:51.769507 2638 consensus_queue.cc:1048] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20251215 20:52:51.801043 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:51.760934 3072 raft_consensus.cc:697] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
W20251215 20:52:51.782244 1686 consensus_peers.cc:597] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:51.831737 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 49541.6us
I20251215 20:52:51.842988 1542 catalog_manager.cc:5654] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:51.844388 1542 catalog_manager.cc:5654] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:51.789144 3039 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:51.789526 2999 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:51.788765 2861 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:51.789757 3030 raft_consensus.cc:1068] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
I20251215 20:52:51.829454 2993 raft_consensus.cc:2749] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20251215 20:52:51.860515 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.801256 3006 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.861027 1542 catalog_manager.cc:5654] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:51.802502 2638 raft_consensus.cc:2749] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.781349 3082 raft_consensus.cc:2749] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:51.882212 1542 catalog_manager.cc:5654] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:51.797371 3028 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:51.873579 1686 consensus_peers.cc:597] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:51.886221 1686 consensus_peers.cc:597] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.796268 2897 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:51.806846 2988 raft_consensus.cc:697] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:51.795089 2940 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:51.886788 1686 leader_election.cc:336] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:51.802132 3007 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.791105 2852 consensus_queue.cc:260] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:51.837786 3043 consensus_queue.cc:1048] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20251215 20:52:51.798544 3058 raft_consensus.cc:515] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:51.900514 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:51.861130 3069 consensus_queue.cc:237] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:51.887830 2973 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:51.776149 2935 consensus_queue.cc:260] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:51.912961 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 284195us
I20251215 20:52:51.915278 1612 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:51.938041 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 164942us
I20251215 20:52:51.951212 1761 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.917553 1612 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:51.931555 1758 leader_election.cc:336] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Timed out: RequestConsensusVote RPC to 127.0.106.132:44997 timed out after 1.635s (SENT)
I20251215 20:52:51.955593 1758 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:51.915089 2852 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:51.949340 3030 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.960007 1612 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:51.949281 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 151636us
I20251215 20:52:51.973335 1761 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:51.974395 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 222063us
I20251215 20:52:51.974918 1761 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.956214 3036 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.917739 2973 raft_consensus.cc:2804] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:51.979262 1761 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.958884 2935 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:51.990769 1761 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.991109 1612 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:51.990093 1686 leader_election.cc:336] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:51.977150 2967 raft_consensus.cc:2749] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.999972 1612 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:51.959990 3064 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.972958 2638 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.959863 3088 raft_consensus.cc:2804] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:51.965942 2897 raft_consensus.cc:2749] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.958070 3089 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:51.973614 3082 raft_consensus.cc:2749] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:51.988502 3007 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:51.932781 2988 consensus_queue.cc:237] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:51.988593 2973 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:51.992475 2993 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:51.994966 2735 raft_consensus.cc:2749] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.002725 3061 raft_consensus.cc:2804] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:52.014741 1761 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:51.999795 3087 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.001292 1612 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:51.953450 3072 consensus_queue.cc:237] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.003566 2940 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
W20251215 20:52:52.027277 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:52.016752 1530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 105033us
I20251215 20:52:51.976372 3030 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.011381 3088 raft_consensus.cc:697] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:52.005170 2999 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:52.032141 1612 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:51.992172 3036 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:52.047766 1612 leader_election.cc:400] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:52.048074 1612 leader_election.cc:403] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20251215 20:52:52.029287 1761 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:52.031798 3007 raft_consensus.cc:2749] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.025301 2973 raft_consensus.cc:3060] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.024771 2897 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.050791 1612 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:52.071251 1612 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:52.072113 1612 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:52.027885 3061 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:52.086545 3061 raft_consensus.cc:3060] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.050827 3094 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:52.054418 3086 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:52.087857 3094 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:52.033869 2861 raft_consensus.cc:2749] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.036729 2940 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.092868 2940 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.094385 3088 consensus_queue.cc:237] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.005131 3064 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:52.052212 3087 raft_consensus.cc:2804] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:52.096686 3087 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:52.097121 3087 raft_consensus.cc:3060] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:52.098979 3036 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.100947 3030 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.101967 2818 raft_consensus.cc:493] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:52.102346 3016 raft_consensus.cc:2804] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:52.102890 3000 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:52.007951 2638 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:52.069511 2735 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:52.102053 2775 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.063941 3063 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.011466 3089 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.085884 1612 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:52.102560 2818 raft_consensus.cc:515] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.068532 3097 raft_consensus.cc:2749] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:52:52.103312 3000 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.102205 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:52.078413 1686 leader_election.cc:336] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:52.121963 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 43679.8us
I20251215 20:52:52.103979 3016 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.044808 3058 leader_election.cc:290] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:52.115042 1789 raft_consensus.cc:2410] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20251215 20:52:52.104396 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.118590 3094 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.129777 1788 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 3.
W20251215 20:52:52.111477 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 56978.7us
I20251215 20:52:52.123867 1612 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:52.131117 2258 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:52.113795 3064 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:52.131367 2257 leader_election.cc:336] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:52.132876 1761 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:52.118078 3044 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:52.121587 3000 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.133759 1612 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:52.127249 2775 consensus_queue.cc:1059] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20251215 20:52:52.188987 3029 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:52.113163 2735 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.147722 2868 consensus_queue.cc:1048] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20251215 20:52:52.127350 3016 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:52.052372 2999 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:52.276758 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 143935us
W20251215 20:52:52.274216 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 142845us
W20251215 20:52:52.275627 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:52.274334 1789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46050 (request call id 984) took 1405 ms (client timeout 1621 ms). Trace:
W20251215 20:52:52.309898 1592 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:52.310499 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 176766us
W20251215 20:52:52.280669 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:52.314810 1760 leader_election.cc:336] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:52.298475 2313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:52.331903 3064 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:52.332402 3064 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.332770 3064 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.336787 3044 raft_consensus.cc:697] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:52.337352 2316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:52.337822 3044 consensus_queue.cc:237] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.332109 2317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:52.338936 2317 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:52.344594 3051 raft_consensus.cc:3055] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
W20251215 20:52:52.344239 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:52.289201 3058 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
W20251215 20:52:52.330557 1789 rpcz_store.cc:269] 1215 20:52:50.869054 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:50.874732 (+ 5678us) service_pool.cc:225] Handling call
1215 20:52:52.241457 (+1366725us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001ee6d4. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30bdc645a1 00007f30bdcfef7a 00007f30c2cb0647 00007f30bc240834 00007f30bc2407c2 00007f30bc2406f1 00007f30bc24066c 00007f30bc23f922 00007f30bc03a55c 00007f30bc039996 00007f30bc03933f
1215 20:52:52.274268 (+ 32811us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2849380224}
I20251215 20:52:52.352249 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.353914 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.354054 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.312255 3002 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:52.361461 1795 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:52.361768 1791 raft_consensus.cc:3060] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:52.356092 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:52.355773 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.358881 1612 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:52.307205 3007 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:52.363869 1788 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:52.364077 1609 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:52.365716 1793 raft_consensus.cc:1275] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:52.368112 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:52.368919 2257 leader_election.cc:336] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:52.368991 1788 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:52.356742 3092 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:52.313095 2897 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:52.380414 2897 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.356781 2775 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:52.381582 2775 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.382078 3006 raft_consensus.cc:2749] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.382787 3006 raft_consensus.cc:2749] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:52.385339 2775 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.386680 2312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:52.384584 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.379248 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.388326 1793 raft_consensus.cc:3060] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:52.389539 3007 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.388185 1792 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:52.386804 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:52.387089 2999 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.391434 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.406279 1794 raft_consensus.cc:3060] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:52.315753 3029 raft_consensus.cc:493] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.375962 3058 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.404850 1793 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:52.274552 3061 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.365003 3035 raft_consensus.cc:493] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:52.441408 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.442209 1789 raft_consensus.cc:2393] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 4: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:52.443063 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.444150 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.411165 1791 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:52.351356 3051 raft_consensus.cc:740] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:52.420157 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8350524f9e4a49929464adde48de2442" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.445506 1789 raft_consensus.cc:2376] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4. Re-sending same reply.
I20251215 20:52:52.365002 2861 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:52.358258 3073 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:52.422209 1795 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:52.452014 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.444752 3035 raft_consensus.cc:515] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:52.437211 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.439905 1794 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:52.446466 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.463738 1791 raft_consensus.cc:2376] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.446700 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.449589 3051 consensus_queue.cc:260] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.471966 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.421248 3029 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.476652 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.419121 2638 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:52.474484 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:52.481387 1720 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:52.422205 3075 consensus_meta.cc:287] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.668s user 0.014s sys 0.003s
I20251215 20:52:52.466428 1789 raft_consensus.cc:2376] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.418318 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.440461 3058 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.473338 1795 raft_consensus.cc:2393] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:52.483649 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:52.459527 3104 log.cc:927] Time spent T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.145s user 0.001s sys 0.000s
W20251215 20:52:52.459142 3103 log.cc:927] Time spent T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.143s user 0.000s sys 0.001s
I20251215 20:52:52.457664 3061 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.452214 3063 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.487464 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.499250 1789 raft_consensus.cc:2376] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.500182 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.487680 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.500905 1788 raft_consensus.cc:2376] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.501533 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.501905 1788 raft_consensus.cc:2376] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4. Re-sending same reply.
I20251215 20:52:52.502426 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.382838 3092 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.491549 1792 raft_consensus.cc:2376] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.491748 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.491120 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.492478 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.493005 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.504096 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.504433 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.456744 3035 leader_election.cc:290] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:52.436029 3030 consensus_queue.cc:1048] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20251215 20:52:52.475188 2818 leader_election.cc:290] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.488855 3007 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:52.509984 2320 raft_consensus.cc:1240] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:52.472266 3073 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
W20251215 20:52:52.505473 2852 consensus_meta.cc:287] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.532s user 0.014s sys 0.000s
I20251215 20:52:52.472083 2861 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.512548 3051 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:52.493789 3087 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.535557 3092 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:52.536353 2897 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:52.538348 2861 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.539642 3089 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.535101 3016 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.490900 3075 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.541903 3086 raft_consensus.cc:2749] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:52.553275 3073 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:52.553200 3016 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.558017 3087 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.558945 3029 raft_consensus.cc:515] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:52.561048 3002 raft_consensus.cc:2749] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.561486 3029 leader_election.cc:290] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.563200 3064 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.565580 3064 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:52.591864 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 232776us
W20251215 20:52:52.592330 1609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 228130us
I20251215 20:52:52.603426 1612 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:52.604240 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:52.625407 1721 raft_consensus.cc:1240] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:52.627035 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:52.627779 1721 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
W20251215 20:52:52.608194 1686 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:52.609233 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 210833us
W20251215 20:52:52.629347 1686 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:52.611490 1714 raft_consensus.cc:1240] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: []
I20251215 20:52:52.633584 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:52.636991 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:52.639067 1716 raft_consensus.cc:1240] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:52.648952 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:52.650527 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:52.496531 1786 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.651661 1713 raft_consensus.cc:2393] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:52.652819 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.653095 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:52.653929 1789 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:52.654466 1788 raft_consensus.cc:2393] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:52.653438 1543 catalog_manager.cc:5654] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:52.654718 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:52.655197 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.655637 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.656023 1789 raft_consensus.cc:2376] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.657261 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.658053 1789 raft_consensus.cc:2376] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.654012 1787 pending_rounds.cc:85] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Aborting all ops after (but not including) 1
I20251215 20:52:52.658892 1787 pending_rounds.cc:107] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20251215 20:52:52.659073 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.659734 1788 raft_consensus.cc:2376] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.659899 1789 raft_consensus.cc:2376] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.622627 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:52.619532 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:52.621362 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:52.661619 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:52.662079 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:52.662200 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 58988.4us
I20251215 20:52:52.504844 1791 raft_consensus.cc:2393] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:52.662644 1718 raft_consensus.cc:2393] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:52.662947 1717 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:52.663503 1787 raft_consensus.cc:2889] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:52.663149 1790 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:52.663903 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.664760 1791 raft_consensus.cc:2376] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.665206 1687 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:52.665843 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.661171 1712 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:52.667304 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.661154 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.669145 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.669682 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.670538 1788 raft_consensus.cc:2376] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.670717 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.671737 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.672438 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.640116 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:52.673256 1791 raft_consensus.cc:2376] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4. Re-sending same reply.
I20251215 20:52:52.674202 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.674979 1791 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:52.675047 1718 raft_consensus.cc:1240] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:52.675909 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.508875 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.676905 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:52.505617 1793 raft_consensus.cc:2410] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20251215 20:52:52.506557 1795 raft_consensus.cc:2376] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2. Re-sending same reply.
I20251215 20:52:52.656190 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:52.667285 1687 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:52.693827 2319 raft_consensus.cc:1240] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20251215 20:52:52.694031 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:52.694576 1788 raft_consensus.cc:2376] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3. Re-sending same reply.
I20251215 20:52:52.696353 2735 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:52.697974 1543 catalog_manager.cc:5654] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 3, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 3 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251215 20:52:52.700202 1760 leader_election.cc:336] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:52.701632 1790 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 5.
I20251215 20:52:52.706141 1542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45280 (request call id 188) took 2558 ms. Trace:
I20251215 20:52:52.709120 1786 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:52.717669 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:52.720798 1720 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:52.727035 2806 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:52.661149 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:52.741210 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:52.754492 1612 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:52.756256 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:52.756721 1791 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:52.760670 3035 raft_consensus.cc:2804] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:52.762542 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:52.763271 3051 consensus_queue.cc:1059] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20251215 20:52:52.765318 1792 raft_consensus.cc:2393] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:52.769234 1789 raft_consensus.cc:2393] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate fbfdeb011a604f78a77f04be26573717 in this term.
I20251215 20:52:52.542590 2973 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.544989 2940 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:52.766353 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 67062.6us
I20251215 20:52:52.780576 1788 raft_consensus.cc:1240] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 2. Current term is 3. Ops: [2.3-2.4]
W20251215 20:52:52.789402 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 45321us
I20251215 20:52:52.817456 1793 raft_consensus.cc:1240] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:52.815956 1794 raft_consensus.cc:1240] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:52.782883 1543 catalog_manager.cc:5654] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:52.809053 3094 raft_consensus.cc:2804] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:52.783509 1795 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.826341 3094 raft_consensus.cc:697] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:52.777911 1786 raft_consensus.cc:1275] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20251215 20:52:52.795061 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:52.783180 3016 raft_consensus.cc:2749] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.777428 1791 raft_consensus.cc:1240] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20251215 20:52:52.807837 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 140712us
W20251215 20:52:52.842898 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 48058.8us
I20251215 20:52:52.798190 1790 raft_consensus.cc:1240] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 1. Current term is 2. Ops: []
W20251215 20:52:52.846417 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:52.780094 2806 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:52.857565 3000 consensus_meta.cc:287] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Time spent flushing consensus metadata: real 0.544s user 0.010s sys 0.004s
I20251215 20:52:52.858282 3000 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.860785 1612 leader_election.cc:400] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Vote denied by peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401) with higher term. Message: Invalid argument: T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:52.860355 1543 catalog_manager.cc:5654] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 3, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 3 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:52.802945 3075 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.827533 3094 consensus_queue.cc:237] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.859009 2806 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.868444 3051 consensus_queue.cc:1243] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer fbfdeb011a604f78a77f04be26573717 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20251215 20:52:52.869876 3000 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.859261 1687 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:52.863958 1612 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:52.791168 3095 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:52.777850 3064 raft_consensus.cc:2749] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:52.758311 1542 rpcz_store.cc:276] 1215 20:52:50.147257 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:50.168562 (+ 21305us) service_pool.cc:225] Handling call
1215 20:52:52.705907 (+2537345us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:52.059310 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:52.059900 (+ 590us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:52.059934 (+ 34us) write_op.cc:435] Acquired schema lock
1215 20:52:52.059951 (+ 17us) tablet.cc:660] Decoding operations
1215 20:52:52.061076 (+ 1125us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:52.061135 (+ 59us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:52.061172 (+ 37us) tablet.cc:683] Acquiring locks for 13 operations
1215 20:52:52.062173 (+ 1001us) tablet.cc:699] Row locks acquired
1215 20:52:52.062189 (+ 16us) write_op.cc:260] PREPARE: finished
1215 20:52:52.062346 (+ 157us) write_op.cc:270] Start()
1215 20:52:52.062465 (+ 119us) write_op.cc:276] Timestamp: P: 1765831972062288 usec, L: 0
1215 20:52:52.062479 (+ 14us) op_driver.cc:348] REPLICATION: starting
1215 20:52:52.063162 (+ 683us) log.cc:844] Serialized 5323 byte log entry
1215 20:52:52.457709 (+394547us) op_driver.cc:464] REPLICATION: finished
1215 20:52:52.552194 (+ 94485us) write_op.cc:301] APPLY: starting
1215 20:52:52.552262 (+ 68us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:52.552529 (+ 267us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:52.552651 (+ 122us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:52.554027 (+ 1376us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:52.554263 (+ 236us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
1215 20:52:52.554306 (+ 43us) write_op.cc:312] APPLY: finished
1215 20:52:52.554600 (+ 294us) log.cc:844] Serialized 94 byte log entry
1215 20:52:52.555400 (+ 800us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:52.555543 (+ 143us) write_op.cc:454] Released schema lock
1215 20:52:52.555591 (+ 48us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:52.555932 (+ 341us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:52.555964 (+ 32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16677,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":93349,"apply.run_cpu_time_us":3108,"apply.run_wall_time_us":3721,"num_ops":13,"prepare.queue_time_us":155011,"prepare.run_cpu_time_us":4179,"prepare.run_wall_time_us":4181,"replication_time_us":374019,"thread_start_us":180960,"threads_started":2}]]}
I20251215 20:52:52.769356 3035 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.779755 1715 raft_consensus.cc:2376] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4. Re-sending same reply.
I20251215 20:52:52.871196 1712 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:52.895011 3035 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:52.902966 3095 raft_consensus.cc:1068] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
W20251215 20:52:52.913681 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 105124us
I20251215 20:52:52.914557 1791 raft_consensus.cc:1275] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20251215 20:52:52.916157 3002 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:52.916941 3002 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.918501 1715 raft_consensus.cc:1275] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:52.919162 3002 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:52.920552 3069 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:52.917197 3006 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:52.917685 3030 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
W20251215 20:52:52.926563 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 62758.4us
I20251215 20:52:52.931357 3030 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.941120 3030 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:52.929340 1760 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:52.929767 3006 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.951613 1612 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:52.953091 2775 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:52.953559 2775 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:52.953972 2775 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.956662 3058 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.964015 3058 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:52.965250 3044 consensus_queue.cc:1059] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:52.966609 3064 raft_consensus.cc:3055] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:52.966977 3064 raft_consensus.cc:740] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:52.968024 3064 consensus_queue.cc:260] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.968967 2775 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:52.969386 3064 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.969667 1612 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:52.917065 3114 consensus_queue.cc:1059] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20251215 20:52:52.978621 3051 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:52.977527 1712 consensus_queue.cc:237] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:52.981527 1795 raft_consensus.cc:2468] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 4.
I20251215 20:52:52.982865 2319 raft_consensus.cc:1240] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 1. Current term is 2. Ops: []
I20251215 20:52:52.950312 3006 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:52.986295 2940 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:52.990182 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 131037us
I20251215 20:52:53.000352 2973 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.000780 1687 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:52.993079 1789 raft_consensus.cc:1240] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: []
I20251215 20:52:52.944607 3069 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:52.987192 3029 consensus_queue.cc:1048] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20251215 20:52:53.011821 1612 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:53.018208 2775 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.019299 3099 raft_consensus.cc:2804] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:53.019950 3099 raft_consensus.cc:697] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:53.020728 2935 consensus_queue.cc:1048] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:53.020987 3099 consensus_queue.cc:237] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.021526 2258 leader_election.cc:304] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:53.004165 3058 consensus_queue.cc:1059] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20251215 20:52:53.041217 3035 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.043658 3035 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.051748 3087 raft_consensus.cc:3055] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:53.052219 3087 raft_consensus.cc:740] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.061194 2806 raft_consensus.cc:3055] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:53.061673 2806 raft_consensus.cc:740] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:53.062688 2806 consensus_queue.cc:260] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:53.064450 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 56396us
W20251215 20:52:53.068707 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 73324.4us
W20251215 20:52:53.068976 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 50524.3us
I20251215 20:52:53.079557 1612 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:53.090672 2935 consensus_queue.cc:1048] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20251215 20:52:53.088253 1686 leader_election.cc:336] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.083103 3002 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.099265 3058 consensus_queue.cc:1243] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer fbfdeb011a604f78a77f04be26573717 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20251215 20:52:53.100519 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:53.096113 3095 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:53.096467 1592 auto_rebalancer.cc:663] Could not move replica: Not found: Couldn't find leader for tablet 46f5d70a2d6346c498b6686a9f4cb1c9
W20251215 20:52:53.107652 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet 46f5d70a2d6346c498b6686a9f4cb1c9
I20251215 20:52:53.113337 3058 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:53.113857 3058 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:53.113973 3111 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:53.114260 3058 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.114423 3111 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:53.114816 3111 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:53.112493 1686 leader_election.cc:336] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:53.108870 3095 raft_consensus.cc:1068] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
I20251215 20:52:53.113338 3112 consensus_queue.cc:1048] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20251215 20:52:53.113418 2806 raft_consensus.cc:3060] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:53.132870 3121 log.cc:927] Time spent T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.227s user 0.004s sys 0.000s
W20251215 20:52:53.132884 1760 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:53.134759 1760 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:53.135424 1760 leader_election.cc:336] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.121821 3114 consensus_queue.cc:1048] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20251215 20:52:53.138224 1760 leader_election.cc:336] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:53.139819 1760 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.142632 3087 consensus_queue.cc:260] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.144587 3087 raft_consensus.cc:3060] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:53.145236 3006 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:53.148275 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:53.150463 1612 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:53.112784 3002 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:53.154248 1760 leader_election.cc:336] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.131660 3036 raft_consensus.cc:2804] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:53.158215 1687 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.126449 3044 consensus_queue.cc:1048] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20251215 20:52:53.161744 2775 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:53.157156 3069 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.164515 2775 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:53.162091 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.171669 2775 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:53.162359 3094 raft_consensus.cc:2749] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:53.177856 3030 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.217876 3030 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.223393 3006 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.224243 3058 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.226516 3058 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:53.179291 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 56517.3us
I20251215 20:52:53.166141 3036 raft_consensus.cc:697] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 4 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:53.182741 1787 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
I20251215 20:52:53.197937 3002 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:53.200531 1760 leader_election.cc:336] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.200358 2775 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.201777 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.202418 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86d34bd4c9884678a883bfc6fe5393a8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.202584 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.244604 1791 raft_consensus.cc:2410] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20251215 20:52:53.204329 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.245426 1792 raft_consensus.cc:2376] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4. Re-sending same reply.
W20251215 20:52:53.204792 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 53077.4us
I20251215 20:52:53.247184 1687 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.248785 3035 raft_consensus.cc:2749] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:53.213088 3051 raft_consensus.cc:2749] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:52:53.250900 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:53.251722 3134 log.cc:927] Time spent T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.144s user 0.004s sys 0.000s
I20251215 20:52:53.251791 1687 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.255504 3035 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:53.256115 3035 raft_consensus.cc:697] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:53.257119 3035 consensus_queue.cc:237] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.214649 3111 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.265918 3111 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:53.238188 2258 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
W20251215 20:52:53.266166 1686 leader_election.cc:336] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.267001 3069 raft_consensus.cc:2804] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:53.267416 3069 raft_consensus.cc:493] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:53.267756 3069 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.269493 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717"
I20251215 20:52:53.270241 2319 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.238379 3036 consensus_queue.cc:237] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.278544 3069 raft_consensus.cc:515] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.180981 1612 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:53.255100 1687 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:53.290066 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 123774us
I20251215 20:52:53.292481 2935 raft_consensus.cc:2749] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.293735 3086 raft_consensus.cc:2804] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:53.294339 3086 raft_consensus.cc:697] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.295281 3086 consensus_queue.cc:237] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:53.296788 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:53.297338 2314 raft_consensus.cc:1275] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20251215 20:52:53.298698 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 43725.5us
I20251215 20:52:53.298867 3114 consensus_queue.cc:1048] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:53.299569 1687 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.300331 2806 raft_consensus.cc:2749] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.301625 1687 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.305358 2806 raft_consensus.cc:2749] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.307233 1612 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:53.308440 3051 raft_consensus.cc:3060] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.309056 1612 leader_election.cc:304] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:53.309944 3087 raft_consensus.cc:2749] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:53.311282 1612 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:53.311945 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:53.290076 2775 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.323504 3111 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.330629 3111 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:53.330147 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:53.332795 3111 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.322642 3087 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:53.324523 3002 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.339764 3002 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.341948 3002 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:53.337625 2735 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:53.344516 1760 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.344456 2735 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.346771 2735 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:53.338927 3087 raft_consensus.cc:697] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
W20251215 20:52:53.349546 1760 leader_election.cc:336] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.352833 1687 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.350135 2735 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.354321 2735 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.359988 1612 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
W20251215 20:52:53.361182 1760 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.362053 3051 raft_consensus.cc:2749] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:53.362942 2775 raft_consensus.cc:2804] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:52:53.363503 2775 raft_consensus.cc:697] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.364428 2775 consensus_queue.cc:237] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:53.368585 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 45447.4us
I20251215 20:52:53.369350 1612 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:53.370791 3051 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:53.371344 3051 raft_consensus.cc:697] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.372195 3051 consensus_queue.cc:237] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.373096 2319 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.349647 3087 consensus_queue.cc:237] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.370297 1612 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:53.376663 2806 raft_consensus.cc:2749] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.376654 2735 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:53.387142 3111 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:53.402164 3114 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:53.402572 3114 raft_consensus.cc:1068] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
W20251215 20:52:53.404253 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:53.405328 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 52624.7us
I20251215 20:52:53.407124 3111 raft_consensus.cc:697] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.408048 3111 consensus_queue.cc:237] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:53.420873 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.422012 1787 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.428375 2806 raft_consensus.cc:2955] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:53.434110 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.434585 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:53.409845 3069 leader_election.cc:290] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.437052 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:53.436339 1713 raft_consensus.cc:1275] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20251215 20:52:53.467417 1687 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.468403 1721 raft_consensus.cc:2368] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 4.
I20251215 20:52:53.469038 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.469107 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.465106 1713 pending_rounds.cc:85] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 1
I20251215 20:52:53.470564 1792 raft_consensus.cc:2368] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:53.472003 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.433182 2314 raft_consensus.cc:2955] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:53.480103 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:53.481627 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:53.484784 3002 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:53.485440 3002 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.487771 3002 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:53.494146 3002 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.489594 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:53.491907 1760 leader_election.cc:336] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.500622 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.478603 3150 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.501982 3150 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.503331 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.503890 1792 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:53.504535 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.505134 1793 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.505089 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.505862 1795 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.507253 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.509123 1687 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.509405 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
W20251215 20:52:53.510632 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:53.493217 1787 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 4.
I20251215 20:52:53.511968 1793 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.495033 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.518043 3002 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.488927 3073 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.519037 3073 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.474226 1713 pending_rounds.cc:107] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20251215 20:52:53.524437 1713 raft_consensus.cc:2889] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:53.524776 3035 raft_consensus.cc:2749] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.513851 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.525709 1788 raft_consensus.cc:2393] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:53.514778 2258 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:53.504626 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.526700 3069 raft_consensus.cc:2804] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:53.494386 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:53.527266 1717 raft_consensus.cc:1275] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:52:53.527443 1712 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.527513 3069 raft_consensus.cc:697] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 4 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:53.515748 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7d99999ba4f49a28d840d50bcdcaa16" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.516422 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.504180 3150 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:53.528803 1789 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
W20251215 20:52:53.528935 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:53.518455 1718 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:53.477030 3114 raft_consensus.cc:2749] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.523543 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.524015 3073 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:53.524333 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.526317 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.528198 1720 raft_consensus.cc:1275] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:53.513314 1543 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47186 (request call id 71) took 1182 ms. Trace:
I20251215 20:52:53.532467 1792 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:53.535955 1795 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.537619 1721 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:53.540185 1760 leader_election.cc:336] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.519727 1542 catalog_manager.cc:5654] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 2 to 3, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 3 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:53.542639 1687 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:53.520181 3002 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:53.548669 3109 log.cc:927] Time spent T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
W20251215 20:52:53.547606 1760 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.552884 1791 raft_consensus.cc:1275] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20251215 20:52:53.554149 1760 leader_election.cc:336] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.556409 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 668639c78eab435fb81c2471ddacf0db with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:52:53.540817 3111 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.555796 1542 catalog_manager.cc:5654] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:53.561730 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.562458 1716 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.560941 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.564522 1712 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.565237 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.557312 2775 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.567384 2775 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.564374 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.569845 2775 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:53.571238 3051 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.572157 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.547427 3030 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.573945 3051 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:53.577962 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:53.577466 1687 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.541507 1543 rpcz_store.cc:276] 1215 20:52:52.331341 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:52.332420 (+ 1079us) service_pool.cc:225] Handling call
1215 20:52:53.513227 (+1180807us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:53.113717 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:53.114519 (+ 802us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:53.114567 (+ 48us) write_op.cc:435] Acquired schema lock
1215 20:52:53.114593 (+ 26us) tablet.cc:660] Decoding operations
1215 20:52:53.115269 (+ 676us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:53.115371 (+ 102us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:53.115402 (+ 31us) tablet.cc:683] Acquiring locks for 4 operations
1215 20:52:53.116009 (+ 607us) tablet.cc:699] Row locks acquired
1215 20:52:53.116033 (+ 24us) write_op.cc:260] PREPARE: finished
1215 20:52:53.116198 (+ 165us) write_op.cc:270] Start()
1215 20:52:53.116385 (+ 187us) write_op.cc:276] Timestamp: P: 1765831973116130 usec, L: 0
1215 20:52:53.116422 (+ 37us) op_driver.cc:348] REPLICATION: starting
1215 20:52:53.171894 (+ 55472us) log.cc:844] Serialized 1744 byte log entry
1215 20:52:53.285827 (+113933us) op_driver.cc:464] REPLICATION: finished
1215 20:52:53.397554 (+111727us) write_op.cc:301] APPLY: starting
1215 20:52:53.406214 (+ 8660us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:53.466692 (+ 60478us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:53.488258 (+ 21566us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:53.489026 (+ 768us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:53.489286 (+ 260us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
1215 20:52:53.489355 (+ 69us) write_op.cc:312] APPLY: finished
1215 20:52:53.489652 (+ 297us) log.cc:844] Serialized 40 byte log entry
1215 20:52:53.489869 (+ 217us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:53.489965 (+ 96us) write_op.cc:454] Released schema lock
1215 20:52:53.490032 (+ 67us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:53.490387 (+ 355us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:53.490415 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45099,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":101769,"apply.run_cpu_time_us":2791,"apply.run_wall_time_us":97056,"num_ops":4,"prepare.queue_time_us":157653,"prepare.run_cpu_time_us":3911,"prepare.run_wall_time_us":64791,"replication_time_us":169267,"thread_start_us":108649,"threads_started":2}]]}
I20251215 20:52:53.561759 1542 catalog_manager.cc:5654] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:53.582749 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.583206 1791 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.547818 3087 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:53.586246 1542 catalog_manager.cc:5654] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 2 to 3, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 3 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:53.590384 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.587363 1542 catalog_manager.cc:5654] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 2 to 3, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 3 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:53.590987 1720 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.591691 1542 catalog_manager.cc:5654] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 1 to 2, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:53.583868 3086 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.638680 1542 catalog_manager.cc:5654] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 2 to 3, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 3 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:53.584137 2775 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:53.590343 3114 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.584699 3069 consensus_queue.cc:237] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.588042 3060 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:52:53.664697 1530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 66744.3us
I20251215 20:52:53.588836 3006 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:53.582401 3111 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.672696 1542 catalog_manager.cc:5654] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:53.637609 1712 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
W20251215 20:52:53.665429 1760 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 229 similar messages]
I20251215 20:52:53.589023 3087 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:53.679021 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 101783us
I20251215 20:52:53.680519 1795 raft_consensus.cc:1275] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:52:53.691632 1791 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.693163 1718 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:53.662961 3086 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.706331 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.709230 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.682387 3030 raft_consensus.cc:2764] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20251215 20:52:53.707082 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.710726 1717 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.709529 1795 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.665843 2775 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.691778 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:53.710239 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:53.717015 1687 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.679968 3114 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.679615 3006 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.703203 3051 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.683029 3060 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.724267 1720 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.727630 1791 raft_consensus.cc:1240] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3. Ops: []
I20251215 20:52:53.727972 3035 raft_consensus.cc:2764] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20251215 20:52:53.732626 2735 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:53.727813 3111 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.732889 1687 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.735740 1687 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.699268 3064 consensus_queue.cc:1059] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20251215 20:52:53.737481 1687 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.738730 1687 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.740680 3030 raft_consensus.cc:2749] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.741351 3030 raft_consensus.cc:2749] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:53.746798 1717 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.725889 1713 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:53.754129 2935 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:53.754647 2935 raft_consensus.cc:697] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:53.755752 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.755525 2935 consensus_queue.cc:237] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.757349 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.757926 1790 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.760707 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.761286 1788 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.763785 3086 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.764674 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.765304 1787 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.768705 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:53.769340 1786 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:53.757361 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:53.773135 1794 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:53.773897 1791 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.774788 3006 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.775756 3064 raft_consensus.cc:3055] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:53.776098 3064 raft_consensus.cc:740] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.776582 3114 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:53.777245 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:53.780799 3060 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:53.782739 1790 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.784878 1791 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.787127 1795 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.794533 1788 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.733222 2735 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.776901 3064 consensus_queue.cc:260] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.797343 3064 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:53.797531 2735 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:53.799825 1787 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.800328 1786 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 5.
I20251215 20:52:53.805884 2775 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:53.807634 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:53.803402 1686 leader_election.cc:336] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:53.803529 1592 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:53.821540 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.823973 1612 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:53.824960 3064 raft_consensus.cc:2749] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.826872 3064 consensus_queue.cc:1059] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:53.833608 1721 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:53.834906 1716 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
W20251215 20:52:53.838318 2257 leader_election.cc:336] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:53.841404 2806 raft_consensus.cc:2764] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20251215 20:52:53.876911 1612 leader_election.cc:400] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 4.
I20251215 20:52:53.877658 1612 leader_election.cc:403] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20251215 20:52:53.882992 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:53.881244 3111 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:52:53.892642 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:53.895783 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 157133us
I20251215 20:52:53.896608 1687 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:53.892460 2775 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 4
I20251215 20:52:53.897805 3111 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.901441 3087 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:53.914774 3111 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:53.917747 3030 raft_consensus.cc:2749] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:53.919767 3086 raft_consensus.cc:3055] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:52:53.920178 3086 raft_consensus.cc:740] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.920931 3086 consensus_queue.cc:260] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.922070 3086 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:53.922529 1612 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:53.927770 3111 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:53.928252 3111 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:53.928755 3111 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:53.930701 1612 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:52:53.935017 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:53.923507 3051 consensus_queue.cc:1048] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20251215 20:52:53.940922 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:53.941766 1686 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:53.942315 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:53.942780 1686 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:53.936477 3058 consensus_queue.cc:1048] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:53.928633 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:53.936610 3087 consensus_queue.cc:1048] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20251215 20:52:53.944597 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 351382us
I20251215 20:52:53.947052 1612 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:53.947855 1612 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:53.948230 1789 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20251215 20:52:53.948863 1612 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:53.950125 3051 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:53.951288 3087 raft_consensus.cc:2804] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:53.951790 3087 raft_consensus.cc:697] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.952046 2775 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 4.
I20251215 20:52:53.952939 2775 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:53.956532 2775 raft_consensus.cc:697] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.957516 2775 consensus_queue.cc:237] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.952703 3087 consensus_queue.cc:237] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.954063 3086 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:53.955996 3035 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:53.961549 3035 raft_consensus.cc:1068] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
I20251215 20:52:53.963367 3086 raft_consensus.cc:697] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:53.964572 3086 consensus_queue.cc:237] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:53.942910 3111 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:53.971167 3029 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:53.972002 3111 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:53.965349 1686 consensus_peers.cc:597] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:54.018435 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 121910us
I20251215 20:52:54.018540 3111 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
W20251215 20:52:54.020210 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 71406.7us
I20251215 20:52:54.014219 3051 raft_consensus.cc:697] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:54.021238 1687 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.020890 1612 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:54.023065 1612 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:54.025055 3064 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:54.025653 3168 raft_consensus.cc:2749] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:54.024170 3051 consensus_queue.cc:237] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.027568 3087 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:54.027567 1612 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:54.032315 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.033272 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:54.033542 1760 leader_election.cc:336] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:54.034046 1721 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:54.026589 3064 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.034772 3064 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.035068 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.035701 1792 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:54.038120 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.038774 1792 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:54.040169 3073 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:54.040757 3073 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.045805 3073 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:54.047688 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.054693 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.055486 1792 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:54.028321 3086 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:54.053438 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.041218 3006 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:54.021382 3111 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:54.059003 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.060365 1687 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.061100 3006 raft_consensus.cc:697] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:54.062249 3111 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:54.062033 3006 consensus_queue.cc:237] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.064805 3168 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:54.065229 3168 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.065554 3168 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:54.062825 3086 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.068449 3086 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.068636 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:54.070768 1687 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.071532 2935 raft_consensus.cc:2764] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20251215 20:52:54.071866 1687 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.072642 2935 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:54.073010 2935 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.073138 1687 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.073362 2935 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.074813 1687 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.075475 3035 raft_consensus.cc:2749] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.076146 3035 raft_consensus.cc:2749] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.078361 3064 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:54.081436 1760 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:54.084396 3064 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.055895 3087 raft_consensus.cc:697] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:54.085858 3087 consensus_queue.cc:237] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.088533 3168 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.090587 3073 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:54.091156 3073 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:54.093384 1686 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:54.094709 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.098937 1721 raft_consensus.cc:3055] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:54.099361 1721 raft_consensus.cc:740] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:54.102170 3168 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.103741 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.105620 1720 raft_consensus.cc:1275] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:54.106102 1714 raft_consensus.cc:3055] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:54.106460 1714 raft_consensus.cc:740] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:54.107455 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.107235 1714 consensus_queue.cc:260] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.108896 1788 raft_consensus.cc:1275] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:54.105623 1717 raft_consensus.cc:2468] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:54.111768 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.112435 1788 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:54.112957 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.121408 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:54.121856 1788 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:54.118520 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.119048 1714 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.123708 1721 consensus_queue.cc:260] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.124708 1795 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:52:54.125511 1793 raft_consensus.cc:1275] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:54.126071 1791 raft_consensus.cc:1275] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:54.120854 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.127846 1786 raft_consensus.cc:2393] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 2: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:54.128058 3073 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:54.129829 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:54.130576 1712 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 5: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:54.131080 1714 raft_consensus.cc:1275] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:54.124845 1721 raft_consensus.cc:3060] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:54.138118 1721 raft_consensus.cc:1275] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:54.139322 3035 consensus_queue.cc:1059] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:54.127173 1713 raft_consensus.cc:3055] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Stepping down as leader of term 4
I20251215 20:52:54.140429 2806 raft_consensus.cc:3055] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:52:54.140631 1713 raft_consensus.cc:740] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:54.140952 2806 raft_consensus.cc:740] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:54.141837 2806 consensus_queue.cc:260] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.143153 2806 raft_consensus.cc:3060] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:54.142815 1713 consensus_queue.cc:260] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:54.144129 1713 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:54.146811 1687 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.147648 3160 consensus_queue.cc:1048] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:54.148607 1687 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.151098 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.151708 1789 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:54.152695 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.153330 1792 raft_consensus.cc:2468] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:54.156464 3051 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:54.157933 1687 leader_election.cc:304] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.158943 1612 leader_election.cc:400] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Vote denied by peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401) with higher term. Message: Invalid argument: T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:54.159036 1788 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 5.
I20251215 20:52:54.157073 3035 raft_consensus.cc:2749] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.159986 1612 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.103628 2935 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:54.161301 1760 leader_election.cc:336] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:54.165426 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:54.166826 2935 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:54.170480 1686 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:54.177558 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.176602 3006 raft_consensus.cc:2749] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.184614 3160 raft_consensus.cc:2749] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.175976 1612 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.193076 1687 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.197746 1687 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.197878 1543 catalog_manager.cc:5654] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:54.192520 3051 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:54.194160 2935 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:52:54.200735 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.199954 1543 catalog_manager.cc:5654] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 4 to 5, VOTER 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) evicted. New cstate: current_term: 2 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:54.201726 1612 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.205524 3006 raft_consensus.cc:2749] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.206892 1761 leader_election.cc:304] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.206516 1543 catalog_manager.cc:5654] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:54.210847 1761 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.212010 1792 raft_consensus.cc:1240] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20251215 20:52:54.213009 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.214093 3073 raft_consensus.cc:2749] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.214571 1761 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.215456 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.216729 2735 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:54.217120 2735 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.217484 2735 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:54.218261 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.204780 3168 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:54.219259 3168 raft_consensus.cc:697] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:54.221138 1612 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.199674 3087 raft_consensus.cc:2749] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.224365 3006 raft_consensus.cc:2749] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.220467 3150 raft_consensus.cc:2749] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.220177 3168 consensus_queue.cc:237] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.226907 2935 raft_consensus.cc:493] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:54.227927 2935 raft_consensus.cc:515] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:54.224056 1543 catalog_manager.cc:5654] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 4, leader changed from 95847161b0414d4e92d6cab94956fa57 (127.0.106.131) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 4 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:54.230589 2935 leader_election.cc:290] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:54.230670 3073 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:54.231190 3073 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.232192 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:54.233006 3073 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:54.233136 3051 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:54.233831 1543 catalog_manager.cc:5654] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 1 to 2, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:54.242892 1612 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.239387 3162 raft_consensus.cc:2749] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.241421 1761 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.227365 2806 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
W20251215 20:52:54.243391 1760 leader_election.cc:336] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:54.245287 1686 leader_election.cc:336] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:54.241995 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:54.221975 1713 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:52:54.245733 1686 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.258934 1612 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.260612 3035 raft_consensus.cc:2749] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.250385 2806 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.258180 3051 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:54.266012 2806 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.250151 3150 raft_consensus.cc:2764] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20251215 20:52:54.256672 3160 raft_consensus.cc:493] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:54.267957 3160 raft_consensus.cc:515] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.263299 3094 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:54.268783 3094 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:54.269860 3160 leader_election.cc:290] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.270562 3094 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:54.275487 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0bb86f5c9ae14081b0e0633dacbfcb59" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:54.262053 3179 log.cc:927] Time spent T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.058s user 0.000s sys 0.001s
W20251215 20:52:54.272217 1686 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.281384 1612 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.283264 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.284962 1721 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:54.285462 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:54.284170 1686 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:54.286082 1718 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 3.
I20251215 20:52:54.285776 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b3dcc96cf314cf3a1f3d46c0b6ee0e3" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:54.287503 1717 raft_consensus.cc:3060] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.289918 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.290577 1715 raft_consensus.cc:2468] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:52:54.291458 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.291560 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.292421 1718 raft_consensus.cc:2393] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 4: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:54.281276 3064 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:54.297336 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.260653 3073 consensus_queue.cc:1048] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20251215 20:52:54.272809 3051 raft_consensus.cc:697] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:54.285149 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2355bff2629046d8aedcfc2f63a52c18" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:54.285213 3087 raft_consensus.cc:3060] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:54.306450 1716 raft_consensus.cc:1275] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251215 20:52:54.307952 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.310235 1720 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:52:54.281445 3035 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:54.303608 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:54.296890 3086 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:54.313155 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.306559 1721 raft_consensus.cc:2393] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 3: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:54.306713 3006 raft_consensus.cc:2749] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.315229 3051 consensus_queue.cc:237] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.317051 1612 leader_election.cc:304] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.317291 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.317850 1720 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:54.317667 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:54.318385 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 62811us
I20251215 20:52:54.318802 1716 raft_consensus.cc:2393] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 4: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:54.315832 3086 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.304406 3064 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.322448 3086 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.322643 3064 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:54.323587 1686 leader_election.cc:336] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:54.312860 1714 raft_consensus.cc:1275] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20251215 20:52:54.325847 1714 pending_rounds.cc:85] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 4
I20251215 20:52:54.326093 1714 pending_rounds.cc:107] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20251215 20:52:54.326321 1714 raft_consensus.cc:2889] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:54.327323 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.329032 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.332083 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:54.332353 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:54.323000 1715 raft_consensus.cc:1240] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Rejecting Update request from peer 95847161b0414d4e92d6cab94956fa57 for earlier term 3. Current term is 4. Ops: []
W20251215 20:52:54.334769 1686 leader_election.cc:336] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:54.335131 1612 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:54.330736 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.335937 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.331064 3006 raft_consensus.cc:2749] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:54.332878 3086 consensus_queue.cc:1048] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20251215 20:52:54.339411 1717 raft_consensus.cc:2468] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 4.
I20251215 20:52:54.340675 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:54.341176 1717 raft_consensus.cc:2393] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 2: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:54.342988 1712 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20251215 20:52:54.343415 3006 raft_consensus.cc:2749] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.333370 2735 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:54.345973 2735 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:54.356377 1612 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.313915 3035 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:54.358048 1686 leader_election.cc:336] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:54.360459 1612 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.360882 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.361478 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.361508 1686 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:54.354398 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.363888 1612 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:54.364020 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.360456 3006 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:54.362615 2775 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:54.339521 3064 consensus_queue.cc:1048] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20251215 20:52:54.368945 2258 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.370893 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.370457 3006 raft_consensus.cc:697] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:54.373427 2775 raft_consensus.cc:697] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:54.372763 3060 raft_consensus.cc:2749] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.374550 3069 consensus_queue.cc:1048] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:52:54.373651 3006 consensus_queue.cc:237] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.368502 3160 raft_consensus.cc:2749] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.372563 3169 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:54.376179 3035 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:54.374449 3060 consensus_queue.cc:1048] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20251215 20:52:54.374373 2775 consensus_queue.cc:237] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.371502 3167 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:54.380123 3167 raft_consensus.cc:697] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:54.381001 3167 consensus_queue.cc:237] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:54.386286 1760 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:54.388473 1686 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.385015 1612 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:54.392247 1612 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:54.384984 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.378733 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:54.396426 1761 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.396679 3170 consensus_queue.cc:1048] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:54.397601 1782 tablet_service.cc:1552] Processing DeleteTablet for tablet 668639c78eab435fb81c2471ddacf0db with delete_type TABLET_DATA_TOMBSTONED (TS 95847161b0414d4e92d6cab94956fa57 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46036
I20251215 20:52:54.383983 3169 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.396847 3086 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:54.405383 3086 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.405736 3086 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.400147 1612 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.404991 3150 raft_consensus.cc:2764] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20251215 20:52:54.395023 3111 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:54.409951 1761 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.389775 3060 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20251215 20:52:54.404506 1541 catalog_manager.cc:5654] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:54.415958 3058 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251215 20:52:54.417825 1541 catalog_manager.cc:5654] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:54.408325 1712 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:54.412979 3111 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.415908 3170 raft_consensus.cc:2749] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.429751 1761 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.430928 1541 catalog_manager.cc:5654] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 3, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:54.430518 3111 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.425413 3058 consensus_queue.cc:1048] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20251215 20:52:54.431787 3073 raft_consensus.cc:2804] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20251215 20:52:54.454648 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.469527 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20251215 20:52:54.470057 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 59054.3us
I20251215 20:52:54.452086 2735 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.471792 1612 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:54.464274 3073 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.474639 1612 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:54.470431 3087 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.480543 3006 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:54.484314 3169 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.488901 1789 raft_consensus.cc:1275] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20251215 20:52:54.490388 3086 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.492185 3051 raft_consensus.cc:2804] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
W20251215 20:52:54.495877 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.481557 3073 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:52:54.500741 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 71084us
I20251215 20:52:54.513010 1761 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.503175 426 tablet_replica.cc:333] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:54.479215 2775 consensus_queue.cc:1048] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20251215 20:52:54.519941 1761 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:54.518169 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 43609.4us
I20251215 20:52:54.500361 3006 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.521045 1612 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:54.518185 2806 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:54.505501 3051 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:54.529376 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.530009 1718 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:54.530215 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.530884 1789 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 2.
I20251215 20:52:54.519227 3150 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.542977 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:54.533533 2735 raft_consensus.cc:2764] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20251215 20:52:54.545326 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:54.546080 1788 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.534390 1761 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.537009 1715 raft_consensus.cc:1275] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:54.537710 3200 tablet_replica.cc:333] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:52:54.521829 3006 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.512482 3029 consensus_queue.cc:1048] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20251215 20:52:54.532023 2806 raft_consensus.cc:1068] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
I20251215 20:52:54.532545 3051 raft_consensus.cc:3060] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:54.562490 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cffb60a2970e4e049f29999509c860aa" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.553911 1789 raft_consensus.cc:1275] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:52:54.547822 1761 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.564059 3200 raft_consensus.cc:2243] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:54.564628 1761 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.564810 3200 raft_consensus.cc:2272] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:54.566793 1720 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:52:54.567718 3200 ts_tablet_manager.cc:1916] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251215 20:52:54.567981 1720 raft_consensus.cc:1275] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:54.560204 426 raft_consensus.cc:2243] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:54.551057 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.553790 3195 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:54.568542 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.570180 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f91c85f57504082af247cc60403edd1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.553432 3169 raft_consensus.cc:493] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:54.571007 3002 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:54.628796 3002 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:54.573701 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.629240 3002 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.575932 1761 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.559492 1788 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:54.577208 1612 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.570766 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:54.632512 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 56632us
I20251215 20:52:54.632723 1790 raft_consensus.cc:2468] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:54.623703 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.633351 1761 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.633781 1786 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:54.553673 3190 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.634219 3189 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:54.634479 1761 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.635478 1761 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:54.642372 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 65231.3us
I20251215 20:52:54.651710 3064 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:54.638814 3170 raft_consensus.cc:493] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:54.644440 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.668815 1612 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:54.648761 3201 raft_consensus.cc:2749] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.648809 2735 raft_consensus.cc:2749] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:54.673848 3086 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.662781 3087 consensus_queue.cc:1048] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20251215 20:52:54.661983 1713 raft_consensus.cc:1275] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:54.676563 426 raft_consensus.cc:2272] T 8350524f9e4a49929464adde48de2442 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:54.677637 3188 raft_consensus.cc:2749] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.678642 3204 raft_consensus.cc:2749] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.679293 426 tablet_replica.cc:333] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:54.681587 3006 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:54.682534 3050 log.cc:927] Time spent T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
I20251215 20:52:54.683408 3006 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:54.684377 3191 log.cc:927] Time spent T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.186s user 0.000s sys 0.001s
W20251215 20:52:54.686229 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.643860 3169 raft_consensus.cc:515] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.694267 3169 leader_election.cc:290] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.697515 2775 raft_consensus.cc:2804] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:52:54.698025 2775 raft_consensus.cc:493] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:54.698369 3111 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:54.670743 1612 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.698382 2775 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:52:54.669356 3170 raft_consensus.cc:515] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:54.705318 3170 leader_election.cc:290] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:54.705950 3073 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.680184 426 raft_consensus.cc:2243] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:54.708384 426 raft_consensus.cc:2272] T 0bb86f5c9ae14081b0e0633dacbfcb59 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:54.730441 3170 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.757997 3051 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.758862 2775 raft_consensus.cc:515] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.761418 3150 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.726452 3058 consensus_queue.cc:1048] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20251215 20:52:54.728827 3169 consensus_queue.cc:1048] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20251215 20:52:54.765208 3189 raft_consensus.cc:2749] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.662987 3064 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:54.765959 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:54.749787 3002 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:54.779770 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 144317us
W20251215 20:52:54.789428 1760 leader_election.cc:336] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:54.792264 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 53677.7us
I20251215 20:52:54.736172 3195 raft_consensus.cc:697] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:54.809298 1612 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:54.702363 3111 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.821051 1761 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.824594 3189 consensus_queue.cc:1059] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:54.816924 3204 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20251215 20:52:54.835505 1761 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:54.836881 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:54.836472 3190 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.838165 3220 raft_consensus.cc:2749] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.839170 3195 consensus_queue.cc:237] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.833596 3200 ts_tablet_manager.cc:1929] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20251215 20:52:54.840829 3200 log.cc:1199] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: Deleting WAL directory at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0/minicluster-data/ts-2-root/wals/668639c78eab435fb81c2471ddacf0db
I20251215 20:52:54.842948 1531 catalog_manager.cc:4985] TS 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): tablet 668639c78eab435fb81c2471ddacf0db (table test-workload [id=f6efdef5e30a41e2863dee76707b7e6d]) successfully deleted
I20251215 20:52:54.848433 1544 catalog_manager.cc:5654] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:54.850163 3188 raft_consensus.cc:3055] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:54.850556 3188 raft_consensus.cc:740] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:54.850871 1544 catalog_manager.cc:5654] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:54.851347 3188 consensus_queue.cc:260] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:54.851796 3167 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:54.853118 3167 consensus_queue.cc:1048] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:54.809383 3073 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:54.850628 1612 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.820158 3006 raft_consensus.cc:2804] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election won for term 3
W20251215 20:52:54.834750 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.871842 1541 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45294 (request call id 185) took 1458 ms. Trace:
W20251215 20:52:54.873178 1686 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:54.874188 1761 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.880882 1761 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.849160 2775 leader_election.cc:290] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.889604 1612 leader_election.cc:304] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:54.890712 1761 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.885012 1544 catalog_manager.cc:5654] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:54.824604 3064 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:54.894745 1761 raft_consensus.cc:2686] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 20:52:54.854693 3002 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:54.894553 1717 raft_consensus.cc:1275] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:54.871629 3073 raft_consensus.cc:2749] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:52:54.885717 3006 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:54.887576 3189 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:54.902640 1790 raft_consensus.cc:1275] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:54.872975 1541 rpcz_store.cc:276] 1215 20:52:53.413581 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:53.418186 (+ 4605us) service_pool.cc:225] Handling call
1215 20:52:54.871767 (+1453581us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:54.447407 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:54.447759 (+ 352us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:54.447783 (+ 24us) write_op.cc:435] Acquired schema lock
1215 20:52:54.447791 (+ 8us) tablet.cc:660] Decoding operations
1215 20:52:54.448154 (+ 363us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:54.448189 (+ 35us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:54.448209 (+ 20us) tablet.cc:683] Acquiring locks for 3 operations
1215 20:52:54.469917 (+ 21708us) tablet.cc:699] Row locks acquired
1215 20:52:54.469940 (+ 23us) write_op.cc:260] PREPARE: finished
1215 20:52:54.482134 (+ 12194us) write_op.cc:270] Start()
1215 20:52:54.497195 (+ 15061us) write_op.cc:276] Timestamp: P: 1765831974481369 usec, L: 0
1215 20:52:54.498562 (+ 1367us) op_driver.cc:348] REPLICATION: starting
1215 20:52:54.544784 (+ 46222us) log.cc:844] Serialized 1316 byte log entry
1215 20:52:54.684172 (+139388us) op_driver.cc:464] REPLICATION: finished
1215 20:52:54.684584 (+ 412us) write_op.cc:301] APPLY: starting
1215 20:52:54.684655 (+ 71us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:54.684790 (+ 135us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:54.684886 (+ 96us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:54.685272 (+ 386us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:54.685414 (+ 142us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
1215 20:52:54.685454 (+ 40us) write_op.cc:312] APPLY: finished
1215 20:52:54.685632 (+ 178us) log.cc:844] Serialized 34 byte log entry
1215 20:52:54.685786 (+ 154us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:54.685872 (+ 86us) write_op.cc:454] Released schema lock
1215 20:52:54.685917 (+ 45us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:54.686177 (+ 260us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:54.686203 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6486,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":237,"apply.run_cpu_time_us":1571,"apply.run_wall_time_us":1571,"num_ops":3,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":2863,"prepare.run_wall_time_us":106330,"replication_time_us":184005}]]}
W20251215 20:52:54.899943 1686 consensus_peers.cc:597] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:54.900246 1788 raft_consensus.cc:1275] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:54.901094 1789 raft_consensus.cc:1240] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: []
I20251215 20:52:54.904868 1761 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.907137 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:54.908478 1788 raft_consensus.cc:1275] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:54.895013 3202 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.893116 3204 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.907262 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:54.920750 1793 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:52:54.896747 3188 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.913280 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "632ff53f1d7b4cf1a811d346f5e0d6e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.923928 1718 raft_consensus.cc:2468] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:54.915481 1612 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:54.894358 3051 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:54.921106 1789 raft_consensus.cc:2393] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 4: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:54.923252 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:54.904268 3006 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:54.923800 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10e7dc78d083418c9f49bb4450d426f7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:54.926304 1720 raft_consensus.cc:2393] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 4: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:54.923163 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:54.980894 1794 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.925992 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:54.927769 1687 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.899307 3217 raft_consensus.cc:2749] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:54.974188 1786 raft_consensus.cc:1275] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:54.989601 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:54.990252 1790 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:54.974763 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:54.974972 3183 log.cc:927] Time spent T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20251215 20:52:54.897199 3170 consensus_queue.cc:1048] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20251215 20:52:54.902380 3167 consensus_queue.cc:1048] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20251215 20:52:54.976197 3199 log.cc:927] Time spent T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
W20251215 20:52:54.977885 3216 log.cc:927] Time spent T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.148s user 0.001s sys 0.000s
I20251215 20:52:54.922066 3002 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:54.992771 1793 raft_consensus.cc:2368] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
W20251215 20:52:54.985064 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 57385.9us
I20251215 20:52:55.000631 1790 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:54.915189 3064 raft_consensus.cc:493] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:55.003957 3214 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.007401 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.005745 426 tablet_replica.cc:333] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:55.009632 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.012024 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.014425 1720 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:55.014638 1716 raft_consensus.cc:2393] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 4: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
W20251215 20:52:55.010807 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 95376.5us
I20251215 20:52:55.012018 1687 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:54.979490 2775 raft_consensus.cc:2749] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:55.014437 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.015288 1612 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:55.015170 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.012512 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:55.011497 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:55.017764 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 196001us
I20251215 20:52:54.926803 3160 consensus_queue.cc:1059] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20251215 20:52:55.039319 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.001487 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.039000 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:55.040066 1793 raft_consensus.cc:2393] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 3: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:55.016325 1612 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:55.045284 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.019320 3168 raft_consensus.cc:2749] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.046664 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:55.006403 2806 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.042691 426 raft_consensus.cc:2243] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:55.047320 1793 raft_consensus.cc:2393] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 4: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:55.047271 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.052253 1612 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:55.052354 1788 raft_consensus.cc:1275] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20251215 20:52:55.011484 3002 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:55.066896 1788 raft_consensus.cc:1275] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:55.019822 3058 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:55.070057 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.064666 1592 placement_policy_util.cc:244] tablet 46f5d70a2d6346c498b6686a9f4cb1c9: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20251215 20:52:55.079926 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "59398fb5c6c84abd94ba4b8ee8ad4d6f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.068720 3087 raft_consensus.cc:2804] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:55.016786 3086 consensus_queue.cc:1048] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20251215 20:52:55.076093 3002 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:55.102638 426 raft_consensus.cc:2272] T 8e5a5566d2334d5f8f6829f319ce32af P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:55.038991 3214 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.107237 1687 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.019075 3064 raft_consensus.cc:515] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.105733 1761 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:55.109664 1761 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:55.113512 1793 raft_consensus.cc:1240] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20251215 20:52:55.116307 1687 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.117480 1687 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.118635 1687 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:55.088739 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:55.088907 3087 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:55.088739 3058 raft_consensus.cc:697] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:55.096086 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:55.127570 3064 leader_election.cc:290] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.130858 1792 raft_consensus.cc:1240] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20251215 20:52:55.131982 1792 raft_consensus.cc:1240] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20251215 20:52:55.132575 3051 consensus_queue.cc:1059] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:55.133632 3217 consensus_queue.cc:1048] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:55.134027 3214 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:55.116511 3189 raft_consensus.cc:2749] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.139278 3195 raft_consensus.cc:3055] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:55.117766 2735 raft_consensus.cc:2749] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.143378 1720 raft_consensus.cc:2468] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:55.117085 2806 raft_consensus.cc:2749] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.130651 3231 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election won for term 5
W20251215 20:52:55.145399 1760 leader_election.cc:336] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:55.141364 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:55.126127 3169 consensus_queue.cc:1048] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20251215 20:52:55.155663 1786 raft_consensus.cc:2393] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 5: Already voted for candidate 9b3367a5854f49b98da54556a209b0de in this term.
I20251215 20:52:55.164979 426 tablet_replica.cc:333] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:55.142800 3035 raft_consensus.cc:2749] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.164628 1792 raft_consensus.cc:1275] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:55.165951 426 raft_consensus.cc:2243] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:55.166564 1794 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:55.122185 3087 raft_consensus.cc:3060] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:55.169960 1789 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:55.170507 1794 raft_consensus.cc:1240] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20251215 20:52:55.172722 1789 raft_consensus.cc:1240] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: []
I20251215 20:52:55.165802 1760 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:55.184238 426 pending_rounds.cc:70] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
W20251215 20:52:55.161027 3223 log.cc:927] Time spent T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.185s user 0.003s sys 0.000s
I20251215 20:52:55.191318 1794 raft_consensus.cc:1240] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 3. Current term is 4. Ops: []
I20251215 20:52:55.188721 1789 raft_consensus.cc:1275] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:55.142604 3195 raft_consensus.cc:740] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:55.184590 426 pending_rounds.cc:77] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7232847767107530752 op_type: NO_OP noop_request { }
I20251215 20:52:55.194200 426 raft_consensus.cc:2889] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:55.194576 426 raft_consensus.cc:2272] T 113c523599f94be28a277e199067cf22 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:55.166286 3231 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:55.156459 3228 raft_consensus.cc:2749] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:55.201157 1789 raft_consensus.cc:1275] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20251215 20:52:55.280241 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 77946.9us
I20251215 20:52:55.196269 1786 raft_consensus.cc:1240] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 4. Current term is 5. Ops: []
I20251215 20:52:55.189675 3189 raft_consensus.cc:2749] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.347594 3195 consensus_queue.cc:260] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.331611 2735 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.348850 2735 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.325858 3235 raft_consensus.cc:2749] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:55.181811 3006 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.350909 2735 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:55.351477 3006 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.199791 3231 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:55.355611 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:55.354815 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 242626us
I20251215 20:52:55.363229 3235 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.363696 3235 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.365326 3169 consensus_queue.cc:1048] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:55.325963 3058 consensus_queue.cc:237] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.367831 3169 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:55.369654 426 tablet_replica.cc:333] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:55.369968 1612 leader_election.cc:400] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Vote denied by peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401) with higher term. Message: Invalid argument: T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:55.370314 1612 leader_election.cc:403] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20251215 20:52:55.370620 426 raft_consensus.cc:2243] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:52:55.371462 3169 raft_consensus.cc:3060] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:55.372232 426 pending_rounds.cc:70] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:55.372509 426 pending_rounds.cc:77] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7232847762909405184 op_type: NO_OP noop_request { }
I20251215 20:52:55.372809 426 raft_consensus.cc:2889] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:55.374963 426 raft_consensus.cc:2272] T e1388514310d41f78bca30dd0dac6f46 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:55.376788 1612 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:55.377938 1612 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:55.381210 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:55.371413 3195 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:55.399972 3006 raft_consensus.cc:2749] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:52:55.405725 3223 log.cc:927] Time spent T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
I20251215 20:52:55.425675 1790 raft_consensus.cc:2410] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20251215 20:52:55.425909 3204 consensus_queue.cc:1048] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:55.426157 3086 consensus_queue.cc:1048] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:55.425988 3218 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.428495 3230 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:55.428829 3231 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:55.429648 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:55.430289 426 tablet_replica.cc:333] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:55.463724 426 raft_consensus.cc:2243] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:52:55.431695 1612 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:55.435415 3169 raft_consensus.cc:2749] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401) with higher term. Message: Invalid argument: T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:55.445580 3235 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:55.461997 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 343367us
I20251215 20:52:55.466168 1687 leader_election.cc:304] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.472779 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.476053 1788 raft_consensus.cc:1275] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20251215 20:52:55.470983 1714 raft_consensus.cc:1275] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:55.460600 3218 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.465291 3230 raft_consensus.cc:697] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:55.468474 3086 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:55.471419 3235 raft_consensus.cc:2749] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.475888 3239 consensus_queue.cc:1059] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20251215 20:52:55.478808 1794 raft_consensus.cc:1275] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20251215 20:52:55.478166 1687 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.479260 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:55.479017 3168 raft_consensus.cc:3055] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:55.497234 1789 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:55.497467 3168 raft_consensus.cc:740] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:55.498315 3168 consensus_queue.cc:260] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.499380 3168 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:55.492065 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:55.504155 1789 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
W20251215 20:52:55.488621 3222 log.cc:927] Time spent T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.514s user 0.007s sys 0.003s
I20251215 20:52:55.486742 3231 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.520929 1687 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.491534 3239 raft_consensus.cc:3055] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:55.495934 3086 raft_consensus.cc:697] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:55.510238 3006 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:55.525396 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 326342us
I20251215 20:52:55.518253 3188 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.530409 3188 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:55.532435 3247 raft_consensus.cc:2749] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20251215 20:52:55.533298 3006 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.535220 3006 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.489380 3229 consensus_queue.cc:1059] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20251215 20:52:55.536576 3229 raft_consensus.cc:3055] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Stepping down as leader of term 4
I20251215 20:52:55.536911 3229 raft_consensus.cc:740] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:55.537608 3229 consensus_queue.cc:260] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:55.538369 3225 log.cc:927] Time spent T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.561s user 0.000s sys 0.002s
I20251215 20:52:55.538920 3245 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:55.539319 3203 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.539438 3245 raft_consensus.cc:697] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:55.539800 3203 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:55.540357 3245 consensus_queue.cc:237] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.488765 3002 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:55.551294 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:55.478339 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e8905748575496cb493cddc6f527786" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:55.550028 3167 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.553714 3167 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.553996 3203 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.555495 3167 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.524171 3239 raft_consensus.cc:740] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:55.569790 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.571197 1790 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 4.
I20251215 20:52:55.573357 1792 raft_consensus.cc:1275] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20251215 20:52:55.545631 3231 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.487287 3243 consensus_queue.cc:1059] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20251215 20:52:55.582320 1612 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:55.559494 3188 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:55.485494 3230 consensus_queue.cc:237] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.583240 1787 raft_consensus.cc:1240] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20251215 20:52:55.550794 3235 consensus_queue.cc:1059] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
W20251215 20:52:55.591064 1592 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:55.564985 3160 consensus_queue.cc:1048] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20251215 20:52:55.527097 3249 consensus_queue.cc:1059] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20251215 20:52:55.592995 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:55.593984 1795 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:55.587430 3006 consensus_queue.cc:1048] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20251215 20:52:55.586439 3242 consensus_queue.cc:1048] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20251215 20:52:55.584434 3231 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.581229 3167 consensus_queue.cc:1048] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20251215 20:52:55.564396 3162 consensus_queue.cc:1059] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
W20251215 20:52:55.599908 2257 leader_election.cc:336] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:55.588649 3169 raft_consensus.cc:2804] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:55.575614 3087 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.612525 1795 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 5.
I20251215 20:52:55.586638 3170 consensus_queue.cc:1048] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20251215 20:52:55.617004 3246 log.cc:927] Time spent T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.097s user 0.000s sys 0.001s
I20251215 20:52:55.615154 3169 raft_consensus.cc:697] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:55.625886 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.630959 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6292c3ac4394235a8d94502dcb65913" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.631209 3248 consensus_queue.cc:1048] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20251215 20:52:55.632174 2806 raft_consensus.cc:3055] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Stepping down as leader of term 3
W20251215 20:52:55.633136 3226 log.cc:927] Time spent T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de: Append to log took a long time: real 0.656s user 0.004s sys 0.016s
I20251215 20:52:55.633486 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.675148 1721 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:55.631006 3229 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:55.694270 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:55.638187 3002 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:55.615002 3242 raft_consensus.cc:3055] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Stepping down as leader of term 3
W20251215 20:52:55.646214 1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:55.649967 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:55.666487 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 99462.1us
I20251215 20:52:55.700369 1795 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:55.700553 1687 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.701175 1612 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:55.620888 3231 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.621587 3218 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:55.666978 1794 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:55.674064 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.601485 3239 consensus_queue.cc:260] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.674676 2806 raft_consensus.cc:740] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:55.681094 1714 raft_consensus.cc:2368] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:55.681859 1721 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
W20251215 20:52:55.695052 1760 leader_election.cc:336] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:55.613112 3086 consensus_queue.cc:237] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.704471 1761 leader_election.cc:304] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.705204 1612 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:55.707792 1789 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:55.703135 3160 raft_consensus.cc:1064] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:55.711175 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:55.711460 3209 log.cc:927] Time spent T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20251215 20:52:55.704097 3035 raft_consensus.cc:2749] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:55.699900 3242 raft_consensus.cc:740] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:55.716454 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.707479 2775 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:55.721268 1721 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:55.722299 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.710391 2314 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:52:55.722918 1789 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:55.726528 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.727638 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f226904c96ca4bddbd43673d79635bd7" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.728273 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.729195 1761 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.719427 3218 raft_consensus.cc:2804] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:55.735200 2258 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:55.725559 3035 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.741966 3240 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:55.742354 3240 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:55.742300 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:55.742794 3240 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:55.743510 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.729118 2775 raft_consensus.cc:697] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Becoming Leader. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:55.744084 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.744503 3157 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:55.745167 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.745920 3239 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:55.746416 3213 consensus_queue.cc:1059] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20251215 20:52:55.747061 3221 log.cc:927] Time spent T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.721s user 0.001s sys 0.002s
I20251215 20:52:55.747319 3170 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20251215 20:52:55.747641 1760 leader_election.cc:336] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:55.749491 3243 raft_consensus.cc:3055] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:55.749866 3243 raft_consensus.cc:740] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
W20251215 20:52:55.749894 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 169738us
W20251215 20:52:55.750555 1686 leader_election.cc:336] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:55.750728 3243 consensus_queue.cc:260] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.751801 3243 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:55.749533 1791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46054 (request call id 798) took 1194 ms. Trace:
I20251215 20:52:55.755930 1789 raft_consensus.cc:1275] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:55.763803 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.764243 1721 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:55.754196 1791 rpcz_store.cc:276] 1215 20:52:54.554742 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:54.554883 (+ 141us) service_pool.cc:225] Handling call
1215 20:52:54.574171 (+ 19288us) raft_consensus.cc:1471] Updating replica for 1 ops
1215 20:52:54.574425 (+ 254us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:54.574450 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
1215 20:52:54.574807 (+ 357us) log.cc:844] Serialized 26 byte log entry
1215 20:52:54.833261 (+258454us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:54.833817 (+ 556us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:54.833939 (+ 122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:55.579289 (+745350us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b440002304c. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bab5bed5 00007f30bab5c8f2 00007f30bd8a657b 00007f30bd8a1e4f 00007f30bd895c0e 00007f30bd894f56 00007f30bd894b78 00007f30bd89e5c1 00007f30bd89e579 00007f30bd89e509
1215 20:52:55.749263 (+169974us) raft_consensus.cc:1685] finished
1215 20:52:55.749282 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:55.749458 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":21038464,"thread_start_us":258148,"threads_started":1,"wal-append.queue_time_us":321074}
W20251215 20:52:55.771204 1760 leader_election.cc:336] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:55.774838 1760 leader_election.cc:336] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:55.776232 1760 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:55.744087 1714 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:55.779973 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:55.780543 1714 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:55.780405 2775 consensus_queue.cc:237] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.740386 3220 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:55.738840 3228 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:55.741448 3218 raft_consensus.cc:697] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:55.768760 3087 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.798573 3228 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.769032 3035 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.806591 3228 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.807456 3035 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.809844 1720 raft_consensus.cc:1275] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:55.725857 3169 consensus_queue.cc:237] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.736917 2806 consensus_queue.cc:260] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.816282 1789 raft_consensus.cc:1240] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Rejecting Update request from peer be5dd78ebc024aefa4d17b3ccf2ea1ac for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20251215 20:52:55.793427 3220 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:55.833024 3220 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:55.843037 3035 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:55.752821 3242 consensus_queue.cc:260] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.882421 1720 raft_consensus.cc:1275] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20251215 20:52:55.882757 3272 log.cc:927] Time spent T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
W20251215 20:52:55.885505 3269 log.cc:927] Time spent T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20251215 20:52:55.876503 3035 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:55.882803 1720 pending_rounds.cc:85] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 1
I20251215 20:52:55.896080 1720 pending_rounds.cc:107] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20251215 20:52:55.896694 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:55.896320 1720 raft_consensus.cc:2889] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20251215 20:52:55.933566 1686 leader_election.cc:336] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:55.940053 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 210898us
I20251215 20:52:55.941977 1687 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:55.864410 1787 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:55.945587 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.949548 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:55.961088 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:55.964376 1686 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:55.938529 3035 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:55.896430 3218 consensus_queue.cc:237] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:55.979986 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:55.996805 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:56.003134 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 60853.2us
I20251215 20:52:55.963538 3228 raft_consensus.cc:2804] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:56.010865 3228 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:56.011876 3228 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:55.968226 3235 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:56.022666 1686 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.025022 1717 raft_consensus.cc:1275] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20251215 20:52:56.027186 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 86121.4us
I20251215 20:52:56.025660 3235 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.028353 1714 raft_consensus.cc:1275] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20251215 20:52:56.029664 1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34150 (request call id 809) took 1117 ms. Trace:
W20251215 20:52:56.030313 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.030094 1713 rpcz_store.cc:276] 1215 20:52:54.911976 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:55.019483 (+107507us) service_pool.cc:225] Handling call
1215 20:52:55.078902 (+ 59419us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:55.095137 (+ 16235us) raft_consensus.cc:1534] Early marking committed up to index 2
1215 20:52:55.123492 (+ 28355us) log.cc:844] Serialized 14 byte log entry
1215 20:52:55.685132 (+561640us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b1800340ea0. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30c3a9ef21 00007f30c3aab901 00007f30bac4d112 00007f30bac4f3b1 00007f30bac4f369 00007f30bac4f2f9 00007f30bac4f2c1 00007f30bac4e5bd 0000000000379254 0000000000379099 00007f30bac303aa
1215 20:52:56.003307 (+318175us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b1800340ea0. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30c3a9ef21 00007f30c3aab901 00007f30bd8a285c 00007f30bac2fffb 00007f30c3a177e9 00007f30bac4c28b 00007f30bac4a52f 00007f30bac4a045 00007f30bdcf2ce0 00007f30bdd05396 00007f30bdd15f07
1215 20:52:56.025257 (+ 21950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:56.029375 (+ 4118us) raft_consensus.cc:1645] Marking committed up to 2
1215 20:52:56.029440 (+ 65us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:56.029505 (+ 65us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:56.029611 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10294,"prepare.queue_time_us":11812,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":54936,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":3093,"spinlock_wait_cycles":13528064,"thread_start_us":48239,"threads_started":1}
I20251215 20:52:56.035795 3228 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.028702 1714 pending_rounds.cc:85] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 1
I20251215 20:52:56.042227 1714 pending_rounds.cc:107] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20251215 20:52:56.042459 1714 raft_consensus.cc:2889] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:56.046025 3228 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:56.032267 3275 log.cc:927] Time spent T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
W20251215 20:52:56.030947 3283 log.cc:927] Time spent T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
W20251215 20:52:56.059420 3264 log.cc:927] Time spent T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.100s user 0.000s sys 0.000s
I20251215 20:52:56.060982 3278 consensus_queue.cc:1059] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20251215 20:52:56.061895 3278 raft_consensus.cc:3055] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Stepping down as leader of term 4
I20251215 20:52:56.062213 3278 raft_consensus.cc:740] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:56.062891 3278 consensus_queue.cc:260] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.064107 3278 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:56.056950 3240 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:56.081925 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 131612us
I20251215 20:52:56.082685 1761 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:56.093248 3258 log.cc:927] Time spent T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.459s user 0.003s sys 0.000s
I20251215 20:52:56.095412 426 pending_rounds.cc:70] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 2 pending ops.
I20251215 20:52:56.095724 426 pending_rounds.cc:77] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 5 index: 3 } timestamp: 7232847768950751232 op_type: NO_OP noop_request { }
I20251215 20:52:56.096043 426 raft_consensus.cc:2889] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:56.099267 426 pending_rounds.cc:77] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7232847720068177920 op_type: NO_OP noop_request { }
I20251215 20:52:56.099854 426 raft_consensus.cc:2889] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:56.100229 426 raft_consensus.cc:2272] T a434313be259487d9537e911635a6d90 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.101177 1761 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:56.102766 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.112718 1761 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:56.113883 3285 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:56.115269 1761 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.116259 3285 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:56.116636 3285 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:56.116936 3285 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:56.121692 3303 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:56.100703 3299 raft_consensus.cc:2749] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20251215 20:52:56.134407 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.135695 3220 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.137929 3220 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.143787 3086 raft_consensus.cc:493] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.144385 3086 raft_consensus.cc:515] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:56.144917 3240 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:56.150676 1760 leader_election.cc:336] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:56.130813 3237 log.cc:927] Time spent T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.295s user 0.002s sys 0.000s
I20251215 20:52:56.154955 426 tablet_replica.cc:333] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.155865 426 raft_consensus.cc:2243] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus shutting down.
W20251215 20:52:56.161226 2257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 355300us
I20251215 20:52:56.162005 3086 leader_election.cc:290] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:56.168929 426 raft_consensus.cc:2272] T cffb60a2970e4e049f29999509c860aa P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.180105 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:56.191087 1686 leader_election.cc:336] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:56.191725 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:56.201232 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:56.199853 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:56.203320 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 83538.9us
I20251215 20:52:56.208266 1687 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:56.210016 1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:56.213557 3265 log.cc:927] Time spent T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.587s user 0.003s sys 0.000s
I20251215 20:52:56.214075 3285 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.205926 426 tablet_replica.cc:333] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.218765 426 raft_consensus.cc:2243] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.219306 426 raft_consensus.cc:2272] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.218964 3160 consensus_queue.cc:237] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:56.221927 426 tablet_replica.cc:333] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.223994 3162 raft_consensus.cc:3055] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:56.224439 3162 raft_consensus.cc:740] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:56.225312 3162 consensus_queue.cc:260] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.226965 3278 raft_consensus.cc:2749] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:56.228928 3235 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.231774 2806 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:52:56.224267 1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.236080 1687 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.238732 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:56.239221 1687 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.239288 1790 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:56.242585 426 raft_consensus.cc:2243] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.251336 1790 raft_consensus.cc:2468] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:56.252478 1791 raft_consensus.cc:1275] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20251215 20:52:56.256194 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.257256 3310 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.257773 3310 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.259974 3310 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.261135 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:56.267647 426 raft_consensus.cc:2272] T 5f91c85f57504082af247cc60403edd1 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.268020 1687 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:56.272194 1530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 80684.6us
W20251215 20:52:56.269161 1760 leader_election.cc:336] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:56.271363 1686 consensus_peers.cc:597] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:56.242199 3035 raft_consensus.cc:2749] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:56.244196 3228 raft_consensus.cc:2749] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251215 20:52:56.274744 1686 leader_election.cc:336] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.253434 3285 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.298326 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.299288 1687 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.274845 1715 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:56.275563 3249 raft_consensus.cc:2804] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:56.299229 1718 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
W20251215 20:52:56.315542 1760 leader_election.cc:336] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.318965 3249 raft_consensus.cc:697] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:56.323369 3168 raft_consensus.cc:1027] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: attempt to promote peer fbfdeb011a604f78a77f04be26573717: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20251215 20:52:56.325167 1592 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:56.325493 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.319873 3249 consensus_queue.cc:237] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.332795 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.315788 1715 raft_consensus.cc:2468] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:52:56.322069 3248 raft_consensus.cc:2749] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:56.326761 3302 consensus_queue.cc:1048] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20251215 20:52:56.336308 1761 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.355226 426 tablet_replica.cc:333] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.364276 426 raft_consensus.cc:2243] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.364775 426 pending_rounds.cc:70] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:56.364988 426 pending_rounds.cc:77] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7232847679196557312 op_type: NO_OP noop_request { }
I20251215 20:52:56.365029 3190 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:56.365291 426 raft_consensus.cc:2889] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:56.365658 426 raft_consensus.cc:2272] T a7d99999ba4f49a28d840d50bcdcaa16 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:56.366642 1592 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 59398fb5c6c84abd94ba4b8ee8ad4d6f, TS 9b3367a5854f49b98da54556a209b0de -> TS fbfdeb011a604f78a77f04be26573717 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:56.366974 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 59398fb5c6c84abd94ba4b8ee8ad4d6f, TS 9b3367a5854f49b98da54556a209b0de -> TS fbfdeb011a604f78a77f04be26573717 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.368068 426 tablet_replica.cc:333] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
W20251215 20:52:56.372007 1592 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:56.395871 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.398262 426 raft_consensus.cc:2243] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.398905 426 raft_consensus.cc:2272] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:56.412384 1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:56.425439 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 50848.1us
I20251215 20:52:56.426472 1761 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.430299 1791 raft_consensus.cc:1275] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251215 20:52:56.380584 3190 raft_consensus.cc:493] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:56.433287 3170 raft_consensus.cc:493] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.434648 2806 consensus_queue.cc:1048] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:56.434820 3170 raft_consensus.cc:515] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.436733 3170 leader_election.cc:290] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.424763 3278 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:56.441625 3278 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.442209 2319 raft_consensus.cc:1275] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 LEARNER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251215 20:52:56.443449 3278 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.427543 3285 raft_consensus.cc:2804] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:56.443733 2806 consensus_queue.cc:1048] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:56.444175 3285 raft_consensus.cc:697] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:56.448593 3169 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.449066 3169 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.450850 3169 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.451750 3285 consensus_queue.cc:237] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.434077 3190 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:56.467036 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.467733 1794 raft_consensus.cc:2393] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 4: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:56.467939 3064 raft_consensus.cc:3055] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:56.468319 3064 raft_consensus.cc:740] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:56.469398 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:56.469890 1714 raft_consensus.cc:3060] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:56.469069 3064 consensus_queue.cc:260] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:56.471402 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 138514us
I20251215 20:52:56.472221 3064 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:56.485119 1718 raft_consensus.cc:1275] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:56.487219 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:56.488282 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40b5b64d429c4a079403980321090051" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:56.490063 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.489923 1612 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:56.490974 426 tablet_replica.cc:333] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.491851 1612 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:56.494024 426 raft_consensus.cc:2243] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:56.495646 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:56.495993 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbf9f34352854272976701e2b99044e6" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.496331 1790 raft_consensus.cc:2393] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 4: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:56.493474 3087 raft_consensus.cc:2804] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:56.497094 1788 raft_consensus.cc:1275] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:56.497313 3087 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:56.497670 3087 raft_consensus.cc:3060] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:56.482482 3249 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:56.498673 3249 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.500150 3240 consensus_queue.cc:1048] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:56.500538 3249 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.505901 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.507233 426 pending_rounds.cc:70] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:56.506919 1714 raft_consensus.cc:2468] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:56.507510 426 pending_rounds.cc:77] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 4 index: 2 } timestamp: 7232847767047053312 op_type: NO_OP noop_request { }
I20251215 20:52:56.507802 426 raft_consensus.cc:2889] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:56.508360 1761 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.508545 426 raft_consensus.cc:2272] T dcd94ac4984a4f7f855158085913f825 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.512347 1791 raft_consensus.cc:1240] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20251215 20:52:56.513015 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.514891 1787 raft_consensus.cc:1275] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20251215 20:52:56.500808 3169 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:56.519433 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.481374 2806 raft_consensus.cc:2955] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:56.527602 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:56.533021 1721 raft_consensus.cc:2393] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 4: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:56.526732 3170 raft_consensus.cc:493] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.534089 3170 raft_consensus.cc:515] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.535879 3170 leader_election.cc:290] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:56.529268 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.516018 3285 raft_consensus.cc:2804] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:56.495039 3150 consensus_queue.cc:1048] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20251215 20:52:56.529976 1791 raft_consensus.cc:1275] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20251215 20:52:56.538458 1787 raft_consensus.cc:1275] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20251215 20:52:56.539546 1592 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8bd979146339464bb689a3bbf6826e47, TS 9b3367a5854f49b98da54556a209b0de -> TS fbfdeb011a604f78a77f04be26573717 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:56.539836 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8bd979146339464bb689a3bbf6826e47, TS 9b3367a5854f49b98da54556a209b0de -> TS fbfdeb011a604f78a77f04be26573717 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.540380 3162 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:56.517277 3169 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:56.537194 3285 raft_consensus.cc:697] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:56.542651 3169 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:56.504877 2319 raft_consensus.cc:2955] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:56.545995 1716 raft_consensus.cc:1275] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20251215 20:52:56.546361 3242 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:56.548884 1713 raft_consensus.cc:1275] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20251215 20:52:56.549254 1718 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810b825e4fe44036ba77841772e5192f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.549263 1713 pending_rounds.cc:85] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 2
I20251215 20:52:56.550665 1713 pending_rounds.cc:107] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20251215 20:52:56.550928 1713 raft_consensus.cc:2889] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:56.546319 1716 pending_rounds.cc:85] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 1
I20251215 20:52:56.557231 1716 pending_rounds.cc:107] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20251215 20:52:56.557468 1716 raft_consensus.cc:2889] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20251215 20:52:56.559422 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.557019 3170 raft_consensus.cc:493] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.569224 3170 raft_consensus.cc:515] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.570888 1719 raft_consensus.cc:1275] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20251215 20:52:56.570995 3170 leader_election.cc:290] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.571239 1719 pending_rounds.cc:85] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 1
I20251215 20:52:56.571511 1719 pending_rounds.cc:107] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20251215 20:52:56.571708 1719 raft_consensus.cc:2889] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:56.571803 1541 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47186 (request call id 74) took 1465 ms. Trace:
I20251215 20:52:56.572181 1541 rpcz_store.cc:276] 1215 20:52:55.106619 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:55.106741 (+ 122us) service_pool.cc:225] Handling call
1215 20:52:56.571750 (+1465009us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":374320,"reported_tablets":2}
I20251215 20:52:56.549430 3190 raft_consensus.cc:515] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.580461 1794 raft_consensus.cc:1240] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20251215 20:52:56.570458 3285 consensus_queue.cc:237] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.576588 1720 raft_consensus.cc:1275] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20251215 20:52:56.582441 1720 pending_rounds.cc:85] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 1
I20251215 20:52:56.582666 1720 pending_rounds.cc:107] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20251215 20:52:56.582783 3190 leader_election.cc:290] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.582887 1720 raft_consensus.cc:2889] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:56.583154 3150 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.583618 3150 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.585378 3150 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.585713 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcd94ac4984a4f7f855158085913f825" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:56.586237 1720 raft_consensus.cc:3060] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:56.586695 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.587414 1719 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:56.568259 3087 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.588516 1761 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:56.589277 3087 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.589394 3150 raft_consensus.cc:2804] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:56.591023 3150 raft_consensus.cc:493] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:56.591415 3150 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:56.592868 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:56.593595 1686 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.593926 1686 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:56.594846 1686 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.595208 1686 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:56.590713 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.597806 3229 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:56.598095 426 tablet_replica.cc:333] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.598925 426 raft_consensus.cc:2243] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.599403 426 raft_consensus.cc:2272] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:56.600268 1760 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:56.600473 3249 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:56.602458 426 tablet_replica.cc:333] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.603273 426 raft_consensus.cc:2243] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.603974 3087 raft_consensus.cc:493] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:56.604444 3087 raft_consensus.cc:515] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:56.606602 3087 leader_election.cc:290] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:56.607285 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.608711 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:56.612846 3229 raft_consensus.cc:2749] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251215 20:52:56.617868 1760 leader_election.cc:336] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:56.614499 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 112978us
I20251215 20:52:56.614811 3150 raft_consensus.cc:515] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.595214 1720 raft_consensus.cc:2468] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:52:56.619536 426 raft_consensus.cc:2272] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:56.619896 1760 leader_election.cc:336] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.578904 3169 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.620860 1761 leader_election.cc:304] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.621910 3150 leader_election.cc:290] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.623371 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e5a5566d2334d5f8f6829f319ce32af" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:56.624699 1721 raft_consensus.cc:3060] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:56.623956 3190 raft_consensus.cc:2804] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:56.625710 3190 raft_consensus.cc:697] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:56.626930 426 tablet_replica.cc:333] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.626616 3190 consensus_queue.cc:237] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:56.630761 1760 leader_election.cc:336] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.633315 426 raft_consensus.cc:2243] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.633888 426 raft_consensus.cc:2272] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.637061 1721 raft_consensus.cc:2468] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:52:56.640472 1761 leader_election.cc:304] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:56.641161 3150 raft_consensus.cc:2804] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:56.641593 3150 raft_consensus.cc:697] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:56.641891 3169 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.642357 3150 consensus_queue.cc:237] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.643033 1543 catalog_manager.cc:5654] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 4 to 5, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 5 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } }
I20251215 20:52:56.646075 1543 catalog_manager.cc:5654] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:56.647869 1543 catalog_manager.cc:5654] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 4, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
W20251215 20:52:56.649926 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.654246 1544 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45280 (request call id 189) took 3306 ms. Trace:
I20251215 20:52:56.659044 1787 raft_consensus.cc:2955] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:56.656651 1544 rpcz_store.cc:276] 1215 20:52:53.347501 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:53.347705 (+ 204us) service_pool.cc:225] Handling call
1215 20:52:56.654185 (+3306480us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:55.007936 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:55.120052 (+112116us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:55.122348 (+ 2296us) write_op.cc:435] Acquired schema lock
1215 20:52:55.125176 (+ 2828us) tablet.cc:660] Decoding operations
1215 20:52:55.354824 (+229648us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:55.363076 (+ 8252us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:55.363108 (+ 32us) tablet.cc:683] Acquiring locks for 3 operations
1215 20:52:55.363436 (+ 328us) tablet.cc:699] Row locks acquired
1215 20:52:55.363454 (+ 18us) write_op.cc:260] PREPARE: finished
1215 20:52:55.363583 (+ 129us) write_op.cc:270] Start()
1215 20:52:55.363694 (+ 111us) write_op.cc:276] Timestamp: P: 1765831975363542 usec, L: 0
1215 20:52:55.363715 (+ 21us) op_driver.cc:348] REPLICATION: starting
1215 20:52:55.364386 (+ 671us) log.cc:844] Serialized 1316 byte log entry
1215 20:52:55.602422 (+238036us) op_driver.cc:464] REPLICATION: finished
1215 20:52:55.811292 (+208870us) write_op.cc:301] APPLY: starting
1215 20:52:55.829173 (+ 17881us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:55.844828 (+ 15655us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:55.868030 (+ 23202us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:55.976815 (+108785us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:56.021197 (+ 44382us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
1215 20:52:56.025476 (+ 4279us) write_op.cc:312] APPLY: finished
1215 20:52:56.038222 (+ 12746us) log.cc:844] Serialized 34 byte log entry
1215 20:52:56.038389 (+ 167us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:56.038477 (+ 88us) write_op.cc:454] Released schema lock
1215 20:52:56.038516 (+ 39us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:56.038835 (+ 319us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:56.038864 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39136,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":170958,"apply.run_cpu_time_us":2593,"apply.run_wall_time_us":238880,"num_ops":3,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":3665,"prepare.run_wall_time_us":362971,"replication_time_us":228466,"thread_start_us":55031,"threads_started":1}]]}
I20251215 20:52:56.665102 3308 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:56.696489 3303 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:56.712275 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 58675.6us
I20251215 20:52:56.714231 1612 leader_election.cc:304] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:56.726094 426 tablet_replica.cc:333] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.691188 3308 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.727443 3317 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.752066 426 raft_consensus.cc:2243] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.717006 3303 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.726364 3051 consensus_queue.cc:1048] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20251215 20:52:56.765866 3317 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.774194 3303 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.774834 3317 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.775557 3308 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.783341 426 raft_consensus.cc:2272] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.763430 3087 raft_consensus.cc:2749] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:56.785313 1786 raft_consensus.cc:1275] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:52:56.770423 3170 consensus_queue.cc:1048] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20251215 20:52:56.788707 3317 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.818707 3317 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.820703 3317 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.792241 426 tablet_replica.cc:333] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.820820 3243 consensus_queue.cc:1048] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:56.821807 426 raft_consensus.cc:2243] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:52:56.822460 426 pending_rounds.cc:70] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:56.822683 426 pending_rounds.cc:77] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7232847773990240256 op_type: NO_OP noop_request { }
I20251215 20:52:56.823014 426 raft_consensus.cc:2889] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:56.823320 426 raft_consensus.cc:2272] T 98273a1b4c27409fbf35f33b10ca80f0 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.793550 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.795325 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.825012 1721 raft_consensus.cc:2410] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20251215 20:52:56.802452 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:56.827052 426 tablet_replica.cc:333] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.827884 426 raft_consensus.cc:2243] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.830082 426 pending_rounds.cc:70] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:56.830360 426 pending_rounds.cc:77] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7232847763050934272 op_type: NO_OP noop_request { }
I20251215 20:52:56.830715 426 raft_consensus.cc:2889] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20251215 20:52:56.826973 1686 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.831589 426 raft_consensus.cc:2272] T 4e5d5ba56959418da34e0a6590f4c735 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.834034 426 tablet_replica.cc:333] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.834796 426 raft_consensus.cc:2243] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:56.834726 3002 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:56.836846 1687 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:56.839376 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 101113us
W20251215 20:52:56.841400 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.837237 3002 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.843796 426 raft_consensus.cc:2272] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.839665 3243 raft_consensus.cc:2749] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:56.850750 3170 consensus_queue.cc:1048] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:52:56.852126 1788 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.852552 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.854323 1788 raft_consensus.cc:1275] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:56.854709 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "890b2cb838964cd4974f27cd401f1a01" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.856380 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:56.858436 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed49fbba2c19424aa9617a846079bcb3" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.860587 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f04d2e58d7b495fa12144051af83ae1" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:56.868362 1686 consensus_peers.cc:597] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:56.868898 1719 raft_consensus.cc:1275] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:52:56.870766 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:56.870971 1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:56.846158 3169 consensus_queue.cc:1048] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20251215 20:52:56.872126 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:56.873178 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.873206 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:56.874584 3274 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.874760 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c115c03783ff4ad588081a3566250c5f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.875030 3274 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.877139 3002 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.878572 3339 raft_consensus.cc:493] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:56.878515 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.879256 1719 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:56.879125 3339 raft_consensus.cc:515] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.881157 3339 leader_election.cc:290] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:56.882769 1761 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:56.884382 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b28e18dcf749433caf5edc863540ec32" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:56.888240 1612 leader_election.cc:304] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57
I20251215 20:52:56.891080 1720 raft_consensus.cc:1275] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20251215 20:52:56.884263 3169 raft_consensus.cc:493] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:56.886670 3285 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:56.891813 1612 raft_consensus.cc:2686] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 9b3367a5854f49b98da54556a209b0de: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 20:52:56.895823 1612 leader_election.cc:304] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:56.892249 3150 consensus_queue.cc:1048] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20251215 20:52:56.893006 1786 raft_consensus.cc:1240] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20251215 20:52:56.900488 1612 raft_consensus.cc:2686] T 10e7dc78d083418c9f49bb4450d426f7 P 9b3367a5854f49b98da54556a209b0de: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 20:52:56.902390 1612 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:56.904264 1612 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:56.906653 3170 raft_consensus.cc:2749] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:56.913230 1612 leader_election.cc:400] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 2 election: Vote denied by peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421) with higher term. Message: Invalid argument: T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de for earlier term 2. Current term is 3.
I20251215 20:52:56.914404 1612 leader_election.cc:304] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:56.915459 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:56.916273 1721 raft_consensus.cc:2410] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20251215 20:52:56.895315 3169 raft_consensus.cc:515] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.908142 3243 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:56.906813 3340 raft_consensus.cc:2749] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:52:56.895886 3285 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:56.904031 3274 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:56.928560 426 tablet_replica.cc:333] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.932626 426 raft_consensus.cc:2243] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
W20251215 20:52:56.932377 1760 leader_election.cc:336] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.936702 1760 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:56.940836 426 pending_rounds.cc:70] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:56.941179 426 pending_rounds.cc:77] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7232847727098109952 op_type: NO_OP noop_request { }
I20251215 20:52:56.941550 426 raft_consensus.cc:2889] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:56.941918 426 raft_consensus.cc:2272] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:56.941931 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:56.945204 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:56.920538 3170 consensus_queue.cc:1048] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20251215 20:52:56.924037 3341 raft_consensus.cc:2749] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:56.947736 1612 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:56.952010 1612 raft_consensus.cc:2686] T 40b5b64d429c4a079403980321090051 P 9b3367a5854f49b98da54556a209b0de: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 20:52:56.952745 1612 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:56.948052 1760 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.929165 3243 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:56.954084 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:56.954617 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:56.955148 1760 leader_election.cc:336] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:56.955519 1760 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:56.935058 3333 consensus_queue.cc:1048] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20251215 20:52:56.949990 3002 raft_consensus.cc:2749] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:56.947923 3340 consensus_queue.cc:1048] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20251215 20:52:56.979990 426 tablet_replica.cc:333] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:56.953305 1786 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 4.
I20251215 20:52:56.982481 426 raft_consensus.cc:2243] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:56.988099 426 pending_rounds.cc:70] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:56.988442 426 pending_rounds.cc:77] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7232847771104964608 op_type: NO_OP noop_request { }
I20251215 20:52:56.988863 426 raft_consensus.cc:2889] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:56.989286 426 raft_consensus.cc:2272] T dab5221ac7fd4760b078481dd3a91eb4 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:56.976958 3308 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:56.981931 3170 raft_consensus.cc:2749] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:56.977859 3229 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:56.982069 3266 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:57.000922 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 48228.2us
I20251215 20:52:57.002230 1612 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.002720 3169 leader_election.cc:290] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:57.002982 1612 raft_consensus.cc:2686] T 037b6406285a4af8bec65f6a1fdfca12 P 9b3367a5854f49b98da54556a209b0de: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251215 20:52:57.003540 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:57.003733 1612 leader_election.cc:304] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:57.004371 1612 raft_consensus.cc:2686] T 810b825e4fe44036ba77841772e5192f P 9b3367a5854f49b98da54556a209b0de: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 20:52:57.005299 3217 consensus_queue.cc:1048] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:57.005893 3217 consensus_queue.cc:1243] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer be5dd78ebc024aefa4d17b3ccf2ea1ac log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20251215 20:52:57.007443 3243 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.008670 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.008976 3170 consensus_queue.cc:1048] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:57.010288 3170 consensus_queue.cc:1048] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:57.013703 1721 raft_consensus.cc:1275] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 9b3367a5854f49b98da54556a209b0de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20251215 20:52:57.014037 1721 pending_rounds.cc:85] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 2
I20251215 20:52:57.014257 1721 pending_rounds.cc:107] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20251215 20:52:57.014609 1721 raft_consensus.cc:2889] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20251215 20:52:57.016855 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:57.017518 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:57.019902 1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:57.021705 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:57.030925 1790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf291090f874d4ea5be3c23a51eea18" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.048663 1612 leader_election.cc:304] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:57.049223 1612 raft_consensus.cc:2686] T 2f04d2e58d7b495fa12144051af83ae1 P 9b3367a5854f49b98da54556a209b0de: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 20:52:57.050669 1612 leader_election.cc:304] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.051753 1612 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.052656 3162 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:57.053211 3162 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.055431 3162 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.022336 3266 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.057765 3266 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.060556 3353 consensus_queue.cc:1048] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20251215 20:52:57.062124 3285 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:57.062981 3303 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:57.065774 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.066771 1795 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:57.069023 1612 raft_consensus.cc:2686] T b28e18dcf749433caf5edc863540ec32 P 9b3367a5854f49b98da54556a209b0de: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 20:52:57.069068 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a0578355af497bb35215c17c067b09" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:57.069361 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:57.069984 1612 leader_election.cc:304] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:57.070356 1760 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:57.071110 1686 leader_election.cc:336] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.078569 1686 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:57.000313 3308 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.014110 3229 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:57.050720 3289 raft_consensus.cc:2749] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:57.065500 3340 raft_consensus.cc:2749] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:57.082365 3162 raft_consensus.cc:2749] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:57.101553 1612 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.102787 1612 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.104580 1718 raft_consensus.cc:1275] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20251215 20:52:57.093950 3285 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:57.091434 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:57.111362 426 tablet_replica.cc:333] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:57.113286 426 raft_consensus.cc:2243] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:57.108053 3170 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:57.114048 3285 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:57.117719 3285 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:57.092924 3355 raft_consensus.cc:2749] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:57.123150 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:57.123764 1715 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:52:57.112427 3334 consensus_queue.cc:1059] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20251215 20:52:57.126121 3303 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:57.126546 3303 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:57.115579 426 raft_consensus.cc:2272] T b6292c3ac4394235a8d94502dcb65913 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:57.134894 3352 log.cc:927] Time spent T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.057s user 0.002s sys 0.000s
I20251215 20:52:57.137953 1712 raft_consensus.cc:1275] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20251215 20:52:57.107254 3169 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20251215 20:52:57.142695 3308 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.114326 3002 consensus_queue.cc:1048] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20251215 20:52:57.097393 3190 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:57.144449 3190 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.145041 1761 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:57.146248 3190 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:57.146802 3190 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20251215 20:52:57.147127 3190 raft_consensus.cc:493] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:57.147439 3190 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:52:57.149194 3229 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
W20251215 20:52:57.150084 3343 log.cc:927] Time spent T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.174s user 0.001s sys 0.000s
I20251215 20:52:57.156548 3334 consensus_queue.cc:1243] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer 95847161b0414d4e92d6cab94956fa57 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20251215 20:52:57.157069 3334 raft_consensus.cc:3055] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Stepping down as leader of term 4
I20251215 20:52:57.157408 3334 raft_consensus.cc:740] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:57.158135 3334 consensus_queue.cc:260] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.158732 2806 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:57.159154 3334 raft_consensus.cc:3060] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:57.159736 1686 leader_election.cc:336] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.160315 1686 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:57.161865 3333 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:57.162344 3333 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } attrs { replace: true } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:57.162640 3190 raft_consensus.cc:515] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.163841 426 tablet_replica.cc:333] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:57.165638 426 raft_consensus.cc:2243] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:57.180387 1542 catalog_manager.cc:5654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 3 to 4, leader changed from <none> to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:57.183092 1542 catalog_manager.cc:5654] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:57.206880 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.207103 1612 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.179872 1543 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45294 (request call id 186) took 1482 ms. Trace:
I20251215 20:52:57.215967 1794 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:57.216187 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 48689us
I20251215 20:52:57.216678 1794 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:52:57.219424 1687 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:57.208473 1543 rpcz_store.cc:276] 1215 20:52:55.697533 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:55.697780 (+ 247us) service_pool.cc:225] Handling call
1215 20:52:57.179814 (+1482034us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:56.765517 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:56.788702 (+ 23185us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:56.788736 (+ 34us) write_op.cc:435] Acquired schema lock
1215 20:52:56.788752 (+ 16us) tablet.cc:660] Decoding operations
1215 20:52:56.789300 (+ 548us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:56.789366 (+ 66us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:56.789392 (+ 26us) tablet.cc:683] Acquiring locks for 3 operations
1215 20:52:56.789700 (+ 308us) tablet.cc:699] Row locks acquired
1215 20:52:56.789718 (+ 18us) write_op.cc:260] PREPARE: finished
1215 20:52:56.789840 (+ 122us) write_op.cc:270] Start()
1215 20:52:56.789943 (+ 103us) write_op.cc:276] Timestamp: P: 1765831976789798 usec, L: 0
1215 20:52:56.789962 (+ 19us) op_driver.cc:348] REPLICATION: starting
1215 20:52:56.790566 (+ 604us) log.cc:844] Serialized 1312 byte log entry
1215 20:52:56.897618 (+107052us) op_driver.cc:464] REPLICATION: finished
1215 20:52:56.990120 (+ 92502us) write_op.cc:301] APPLY: starting
1215 20:52:56.994074 (+ 3954us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:57.017508 (+ 23434us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:57.029535 (+ 12027us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:57.112005 (+ 82470us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:57.132510 (+ 20505us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
1215 20:52:57.132555 (+ 45us) write_op.cc:312] APPLY: finished
1215 20:52:57.132770 (+ 215us) log.cc:844] Serialized 34 byte log entry
1215 20:52:57.132931 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:57.133026 (+ 95us) write_op.cc:454] Released schema lock
1215 20:52:57.133069 (+ 43us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:57.133362 (+ 293us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:57.133390 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52568,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":85676,"apply.run_cpu_time_us":2300,"apply.run_wall_time_us":146072,"num_ops":3,"prepare.queue_time_us":78865,"prepare.run_cpu_time_us":2840,"prepare.run_wall_time_us":40350,"replication_time_us":107507,"thread_start_us":83100,"threads_started":2}]]}
I20251215 20:52:57.224072 426 pending_rounds.cc:70] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:57.224392 426 pending_rounds.cc:77] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 4 index: 2 } timestamp: 7232847773018042368 op_type: NO_OP noop_request { }
I20251215 20:52:57.224711 426 raft_consensus.cc:2889] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:57.225106 426 raft_consensus.cc:2272] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:57.159086 3243 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:57.227257 1686 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.230595 1686 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:57.212495 3266 raft_consensus.cc:2749] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:57.159166 2806 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:57.213182 3364 log.cc:927] Time spent T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.056s user 0.000s sys 0.001s
I20251215 20:52:57.210254 3289 consensus_queue.cc:1048] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
W20251215 20:52:57.257478 1760 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.257989 1760 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.252928 1612 leader_election.cc:304] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.274477 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:57.276472 1609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:57.235996 3229 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:57.229918 3354 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:57.239481 3308 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:57.238709 3190 leader_election.cc:290] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:57.280247 1787 raft_consensus.cc:1803] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 1.2
I20251215 20:52:57.279219 1612 leader_election.cc:304] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:57.283159 1787 raft_consensus.cc:2468] T 668639c78eab435fb81c2471ddacf0db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 3.
I20251215 20:52:57.256559 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:57.247249 3333 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:57.233670 3243 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.282101 3354 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:57.285915 3317 raft_consensus.cc:2749] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:57.291949 3190 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:52:57.292793 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:57.281257 3229 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.298230 3341 raft_consensus.cc:2749] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20251215 20:52:57.312625 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 85381.5us
W20251215 20:52:57.310055 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 87215.9us
I20251215 20:52:57.286815 3308 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.303402 3354 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:57.328720 426 tablet_replica.cc:333] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:57.302438 3266 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
W20251215 20:52:57.351047 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 131680us
I20251215 20:52:57.333458 3242 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:57.338686 3162 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 20:52:57.353017 1686 leader_election.cc:336] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.353433 1686 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:57.376539 3266 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:57.376994 3266 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:52:57.351498 3376 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20251215 20:52:57.408577 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 151104us
I20251215 20:52:57.360392 3242 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.361342 3162 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:57.412395 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 63837.1us
W20251215 20:52:57.415542 1686 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.409017 2806 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:57.421893 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:57.422241 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 70589.5us
W20251215 20:52:57.425876 3372 log.cc:927] Time spent T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
W20251215 20:52:57.436803 3368 log.cc:927] Time spent T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57: Append to log took a long time: real 0.091s user 0.001s sys 0.000s
I20251215 20:52:57.414546 3375 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:57.444392 1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:57.446893 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "668639c78eab435fb81c2471ddacf0db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:57.449795 3242 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.453106 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.453789 1791 raft_consensus.cc:2393] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 4: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:57.455704 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:57.464463 1760 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:57.464686 1718 pending_rounds.cc:85] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting all ops after (but not including) 1
I20251215 20:52:57.465837 1718 pending_rounds.cc:107] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20251215 20:52:57.466140 1718 raft_consensus.cc:2889] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:57.418810 3243 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.467440 1716 raft_consensus.cc:1217] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-4.3] Dedup: 2.2->[4.3-4.3]
I20251215 20:52:57.468104 1716 raft_consensus.cc:1240] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20251215 20:52:57.423190 3380 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251215 20:52:57.467551 3366 log.cc:927] Time spent T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.155s user 0.000s sys 0.001s
I20251215 20:52:57.476563 3229 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.477708 3162 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.463869 3375 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.480469 3303 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.481160 3375 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:57.482282 3303 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:57.483400 3266 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:57.485528 3308 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:57.465966 1760 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:57.488199 1760 leader_election.cc:336] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.488646 1760 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:57.493338 1760 leader_election.cc:336] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.508559 1612 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:57.515606 3354 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.496840 3303 raft_consensus.cc:2749] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:57.530411 426 raft_consensus.cc:2243] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus shutting down.
W20251215 20:52:57.531195 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:57.534438 1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:44997, user_credentials={real_user=slave}} blocked reactor thread for 61860.3us
W20251215 20:52:57.532145 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:57.548250 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:57.548346 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 128626us
I20251215 20:52:57.526539 3217 raft_consensus.cc:2749] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:57.529042 3266 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:57.578644 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.580317 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.581769 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.582353 1789 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 2.
W20251215 20:52:57.584267 3367 log.cc:927] Time spent T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.245s user 0.003s sys 0.000s
W20251215 20:52:57.609513 1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 20:52:57.618278 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:57.795135 3397 log.cc:927] Time spent T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.142s user 0.000s sys 0.000s
I20251215 20:52:57.792583 3303 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:57.804211 3303 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:57.806142 3303 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:57.866032 3354 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:57.912940 1760 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.913779 1687 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:57.937356 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:57.939695 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:52:57.956473 1686 leader_election.cc:336] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.956925 1686 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:57.959097 1686 leader_election.cc:336] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:57.959640 1686 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:57.960956 1793 raft_consensus.cc:1240] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: []
W20251215 20:52:57.963994 3393 log.cc:927] Time spent T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.351s user 0.000s sys 0.001s
I20251215 20:52:57.967613 1720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:57.962023 3394 raft_consensus.cc:2804] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:52:57.972653 3394 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:57.973004 3394 raft_consensus.cc:3060] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:57.964182 3379 raft_consensus.cc:2749] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:57.963928 3389 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:57.958068 3170 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:52:57.999707 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:58.000478 1719 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:52:58.003187 1761 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:58.008375 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:58.008971 1793 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:57.992112 1713 raft_consensus.cc:1275] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20251215 20:52:58.012001 1686 leader_election.cc:336] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.016666 1686 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.066376 1793 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 5.
W20251215 20:52:58.067795 1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 60120.5us
W20251215 20:52:58.070642 1686 leader_election.cc:336] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.012898 3002 raft_consensus.cc:2804] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:58.089920 426 raft_consensus.cc:2272] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.078437 3243 raft_consensus.cc:2749] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:58.007642 3170 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:58.089618 3375 raft_consensus.cc:493] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:58.089847 3002 raft_consensus.cc:493] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:58.117054 3064 raft_consensus.cc:493] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:58.077154 3217 consensus_queue.cc:1059] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
W20251215 20:52:58.182049 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 47609.5us
I20251215 20:52:58.150085 3002 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:58.142002 3274 consensus_queue.cc:1048] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20251215 20:52:58.185446 3064 raft_consensus.cc:515] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:58.198388 3170 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:58.199818 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:58.202513 3394 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:58.218828 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:58.219584 1686 leader_election.cc:336] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.189163 2806 raft_consensus.cc:493] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbfdeb011a604f78a77f04be26573717)
I20251215 20:52:58.219954 1686 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.149976 3375 raft_consensus.cc:515] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.227941 3389 raft_consensus.cc:2749] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251215 20:52:58.231823 1686 leader_election.cc:336] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:58.235107 1686 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.235690 1686 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.231056 2806 raft_consensus.cc:515] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:52:58.238073 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:58.240726 1720 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:58.242269 426 tablet_replica.cc:333] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.243103 426 raft_consensus.cc:2243] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.244431 2806 leader_election.cc:290] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:52:58.245828 1686 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.246671 1686 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.247470 426 raft_consensus.cc:2272] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.234731 3379 raft_consensus.cc:2749] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:58.250883 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:58.253324 1787 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
W20251215 20:52:58.255261 3392 log.cc:927] Time spent T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.631s user 0.006s sys 0.005s
I20251215 20:52:58.256846 1687 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.257859 2806 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20251215 20:52:58.241706 3243 raft_consensus.cc:2749] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20251215 20:52:58.259413 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:58.259903 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:58.261263 2806 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:58.262187 1721 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:58.265321 1761 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:58.266438 2806 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:58.267084 2806 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:58.271381 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 182240us
I20251215 20:52:58.274813 1612 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de; no voters:
I20251215 20:52:58.277233 1720 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3367a5854f49b98da54556a209b0de in term 5.
I20251215 20:52:58.269800 3274 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251215 20:52:58.271751 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7403a55fe6fa41268e8b54130c9e785d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:58.279029 2806 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:58.278228 1612 raft_consensus.cc:2686] T 23db9937c6294006a7fac93aa519bad4 P 9b3367a5854f49b98da54556a209b0de: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 20:52:58.283757 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:58.285152 2806 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.285290 3387 raft_consensus.cc:493] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95847161b0414d4e92d6cab94956fa57)
I20251215 20:52:58.285789 3387 raft_consensus.cc:515] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.286700 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:58.287921 1793 raft_consensus.cc:1240] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 3. Current term is 4. Ops: []
I20251215 20:52:58.289054 1687 leader_election.cc:304] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:58.290613 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113c523599f94be28a277e199067cf22" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:58.290841 2806 raft_consensus.cc:2749] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:58.291106 1792 raft_consensus.cc:3060] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:58.292685 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:58.288731 3400 log.cc:927] Time spent T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.153s user 0.003s sys 0.000s
W20251215 20:52:58.298166 1760 leader_election.cc:336] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.298609 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "037b6406285a4af8bec65f6a1fdfca12" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:52:58.294858 1686 leader_election.cc:336] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.299909 1687 leader_election.cc:304] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.298238 3375 leader_election.cc:290] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.303414 3274 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:58.303884 3274 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:58.310735 3387 leader_election.cc:290] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.307415 3064 leader_election.cc:290] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:58.311640 3087 raft_consensus.cc:3055] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:52:58.312008 3087 raft_consensus.cc:740] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
W20251215 20:52:58.313711 1686 leader_election.cc:336] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.315645 1792 raft_consensus.cc:2468] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
W20251215 20:52:58.315979 1686 leader_election.cc:336] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:52:58.316550 1686 leader_election.cc:336] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.316764 1792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16211cc39e2742beb0d2ef6ecc0a042b" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:58.317212 1687 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:58.317936 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:58.318218 1612 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:58.320214 1687 leader_election.cc:304] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
W20251215 20:52:58.324707 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:58.325547 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:58.317824 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1388514310d41f78bca30dd0dac6f46" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:58.332109 3087 consensus_queue.cc:260] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.338439 1786 raft_consensus.cc:3060] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:52:58.338747 3087 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:58.339977 1719 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:58.320426 3240 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:58.340556 1719 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:58.337209 3274 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:58.324642 3377 raft_consensus.cc:2749] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:58.341594 1761 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:58.342235 3274 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:58.342609 3274 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:58.342911 3274 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:58.329186 2319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f8f38b230664bc1a6c03587a328cca0" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:52:58.345212 1760 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.315624 3394 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.320216 3375 raft_consensus.cc:2804] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:58.350531 3375 raft_consensus.cc:697] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:58.351253 3002 raft_consensus.cc:515] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.351385 3375 consensus_queue.cc:237] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.366209 426 tablet_replica.cc:333] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.367002 426 raft_consensus.cc:2243] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.367719 426 raft_consensus.cc:2272] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.369313 3002 leader_election.cc:290] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:58.377116 3385 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:58.377606 3385 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.378279 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a434313be259487d9537e911635a6d90" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:58.378834 1717 raft_consensus.cc:3060] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:52:58.379426 3385 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:58.383352 1786 raft_consensus.cc:2468] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:58.385310 1687 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.386003 3379 raft_consensus.cc:2804] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:52:58.386454 3379 raft_consensus.cc:697] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:58.387215 3379 consensus_queue.cc:237] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.388187 3274 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
W20251215 20:52:58.390691 1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 43868.1us
I20251215 20:52:58.391817 1612 leader_election.cc:304] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:58.393082 3087 raft_consensus.cc:2749] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:58.396171 2806 raft_consensus.cc:2749] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:58.398759 1716 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98273a1b4c27409fbf35f33b10ca80f0" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:58.399305 1716 raft_consensus.cc:3060] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:58.403887 3274 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:58.405876 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:58.410552 1713 raft_consensus.cc:1240] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Rejecting Update request from peer 9b3367a5854f49b98da54556a209b0de for earlier term 5. Current term is 6. Ops: []
I20251215 20:52:58.430773 1716 raft_consensus.cc:2468] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:58.435209 1761 leader_election.cc:304] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:58.441694 1542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47186 (request call id 75) took 1861 ms. Trace:
I20251215 20:52:58.442179 1542 rpcz_store.cc:276] 1215 20:52:56.580217 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:56.580380 (+ 163us) service_pool.cc:225] Handling call
1215 20:52:58.441630 (+1861250us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:57.240198 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:57.329921 (+ 89723us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:57.334310 (+ 4389us) write_op.cc:435] Acquired schema lock
1215 20:52:57.335667 (+ 1357us) tablet.cc:660] Decoding operations
1215 20:52:57.403745 (+ 68078us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:57.405490 (+ 1745us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:57.407208 (+ 1718us) tablet.cc:683] Acquiring locks for 2 operations
1215 20:52:57.420246 (+ 13038us) tablet.cc:699] Row locks acquired
1215 20:52:57.421508 (+ 1262us) write_op.cc:260] PREPARE: finished
1215 20:52:57.455246 (+ 33738us) write_op.cc:270] Start()
1215 20:52:57.467677 (+ 12431us) write_op.cc:276] Timestamp: P: 1765831977442585 usec, L: 0
1215 20:52:57.469483 (+ 1806us) op_driver.cc:348] REPLICATION: starting
1215 20:52:57.478454 (+ 8971us) log.cc:844] Serialized 1044 byte log entry
1215 20:52:58.008856 (+530402us) op_driver.cc:464] REPLICATION: finished
1215 20:52:58.284096 (+275240us) write_op.cc:301] APPLY: starting
1215 20:52:58.296450 (+ 12354us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:58.306850 (+ 10400us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:58.314871 (+ 8021us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:58.330451 (+ 15580us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:58.332857 (+ 2406us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
1215 20:52:58.332903 (+ 46us) write_op.cc:312] APPLY: finished
1215 20:52:58.333071 (+ 168us) log.cc:844] Serialized 28 byte log entry
1215 20:52:58.333215 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:58.333307 (+ 92us) write_op.cc:454] Released schema lock
1215 20:52:58.333343 (+ 36us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:58.334620 (+ 1277us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:58.334649 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45026,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":263385,"apply.run_cpu_time_us":1910,"apply.run_wall_time_us":54616,"num_ops":2,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":3534,"prepare.run_wall_time_us":246201,"replication_time_us":517373,"thread_start_us":145642,"threads_started":1}]]}
I20251215 20:52:58.472432 3317 raft_consensus.cc:493] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:58.472998 3317 raft_consensus.cc:515] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.474565 3087 raft_consensus.cc:493] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:58.475073 3317 leader_election.cc:290] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.476580 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:58.477159 1713 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:58.481765 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:58.495532 426 tablet_replica.cc:333] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.488217 1717 raft_consensus.cc:2468] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 6.
I20251215 20:52:58.475101 3087 raft_consensus.cc:515] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:58.507230 426 raft_consensus.cc:2243] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
W20251215 20:52:58.508988 1760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 60313.5us
I20251215 20:52:58.438872 3002 raft_consensus.cc:2804] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:52:58.510490 426 raft_consensus.cc:2272] T 6fb924e2d4664d11b09b8aa8eccab15d P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:58.510910 1760 leader_election.cc:336] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.512631 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:58.510812 1592 placement_policy_util.cc:244] tablet 46f5d70a2d6346c498b6686a9f4cb1c9: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20251215 20:52:58.514546 1544 catalog_manager.cc:5654] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 2 to 4, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:58.517107 1544 catalog_manager.cc:5654] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 2, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.518548 1761 leader_election.cc:304] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.520071 1544 catalog_manager.cc:5654] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:58.506150 3087 leader_election.cc:290] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.522264 1544 catalog_manager.cc:5654] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.524655 1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 985) took 1003 ms. Trace:
I20251215 20:52:58.524328 1544 catalog_manager.cc:5654] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.526669 1544 catalog_manager.cc:5654] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 3, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.529076 1544 catalog_manager.cc:5654] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.529595 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:58.530316 1787 raft_consensus.cc:2393] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b3367a5854f49b98da54556a209b0de in current term 5: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:58.510062 3341 consensus_queue.cc:1059] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20251215 20:52:58.525146 1718 rpcz_store.cc:276] 1215 20:52:57.527879 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:57.796662 (+268783us) service_pool.cc:225] Handling call
1215 20:52:58.380916 (+584254us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0f972 00007f30c3ab8069 00007f30c2c3a260 00007f30c2d02dbb 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:58.381088 (+ 172us) raft_consensus.cc:1471] Updating replica for 0 ops
1215 20:52:58.381271 (+ 183us) raft_consensus.cc:1534] Early marking committed up to index 3
1215 20:52:58.381547 (+ 276us) log.cc:844] Serialized 14 byte log entry
1215 20:52:58.522424 (+140877us) log.cc:844] Serialized 14 byte log entry
1215 20:52:58.522608 (+ 184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
1215 20:52:58.524329 (+ 1721us) raft_consensus.cc:1645] Marking committed up to 3
1215 20:52:58.524440 (+ 111us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:58.524513 (+ 73us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:58.524607 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1410,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":168,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":125,"spinlock_wait_cycles":39190912,"thread_start_us":129370,"threads_started":1}
I20251215 20:52:58.533739 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8b4250dab5b409685b9c36ce1898c9b" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:58.523911 1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34136 (request call id 982) took 1001 ms. Trace:
I20251215 20:52:58.522298 3002 raft_consensus.cc:697] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:58.526481 3289 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:58.542726 1612 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:58.542953 1760 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.543373 1760 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:58.541060 3382 raft_consensus.cc:2804] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Leader election won for term 6
I20251215 20:52:58.533862 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f78523b75e1f4e8a937902c8178099db" candidate_uuid: "9b3367a5854f49b98da54556a209b0de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:58.553400 3382 raft_consensus.cc:697] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 6 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:58.554268 3382 consensus_queue.cc:237] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.562199 426 tablet_replica.cc:333] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
W20251215 20:52:58.562803 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 44323.5us
I20251215 20:52:58.562801 426 raft_consensus.cc:2243] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
W20251215 20:52:58.561841 1760 leader_election.cc:336] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.567983 426 raft_consensus.cc:2272] T 9f3342ae83724ded89bf01a1e27047be P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.576519 3002 consensus_queue.cc:237] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.563966 3341 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:58.585731 1612 leader_election.cc:304] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b3367a5854f49b98da54556a209b0de; no voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:52:58.588606 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:58.550645 3289 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.591733 3379 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:58.604972 3169 raft_consensus.cc:3055] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Stepping down as leader of term 5
I20251215 20:52:58.605362 3169 raft_consensus.cc:740] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9b3367a5854f49b98da54556a209b0de, State: Running, Role: LEADER
I20251215 20:52:58.606063 3169 consensus_queue.cc:260] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:58.606503 1717 consensus_queue.cc:237] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:58.607136 3169 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:52:58.585230 3420 raft_consensus.cc:2749] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:58.590785 3355 raft_consensus.cc:2749] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:52:58.612324 3289 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:58.603570 3379 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.622289 426 tablet_replica.cc:333] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
W20251215 20:52:58.622654 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20251215 20:52:58.623081 426 raft_consensus.cc:2243] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus shutting down.
W20251215 20:52:58.623456 1760 leader_election.cc:336] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.623605 426 pending_rounds.cc:70] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:58.592417 1713 raft_consensus.cc:2468] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:52:58.624015 426 pending_rounds.cc:77] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 2 index: 5 } timestamp: 7232847726871392256 op_type: NO_OP noop_request { }
I20251215 20:52:58.624464 426 raft_consensus.cc:2889] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:58.625169 426 raft_consensus.cc:2272] T 3f8f38b230664bc1a6c03587a328cca0 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.627909 426 tablet_replica.cc:333] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.628744 426 raft_consensus.cc:2243] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.539218 1715 rpcz_store.cc:276] 1215 20:52:57.520621 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:57.536908 (+ 16287us) service_pool.cc:225] Handling call
1215 20:52:58.260477 (+723569us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5800270c98. stack: 00007f30bac1b083 00007f30bac1af80 00007f30ba56d574 00007f30c42286b4 00007f30c4228649 00007f30baa8d781 00007f30bac0fac1 00007f30bac0fe3e 000000000035a3c9 00007f30c2c3a560 00007f30c2d02dd4 00007f30c2d02e41 00007f30c2cc4af0 00007f30c2caf459 00007f30c2caef02 00007f30bc23bd34
1215 20:52:58.268990 (+ 8513us) raft_consensus.cc:1471] Updating replica for 2 ops
1215 20:52:58.280193 (+ 11203us) raft_consensus.cc:1534] Early marking committed up to index 0
1215 20:52:58.281546 (+ 1353us) raft_consensus.cc:1539] Triggering prepare for 2 ops
1215 20:52:58.282135 (+ 589us) log.cc:844] Serialized 52 byte log entry
1215 20:52:58.317029 (+ 34894us) raft_consensus.cc:1645] Marking committed up to 1
1215 20:52:58.318240 (+ 1211us) raft_consensus.cc:1697] Filling consensus response to leader.
1215 20:52:58.319108 (+ 868us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1215 20:52:58.506088 (+186980us) raft_consensus.cc:1685] finished
1215 20:52:58.506119 (+ 31us) raft_consensus.cc:1691] UpdateReplicas() finished
1215 20:52:58.521980 (+ 15861us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":101490,"raft.queue_time_us":1201,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":105202,"spinlock_wait_cycles":872275840,"thread_start_us":25229,"threads_started":1,"wal-append.queue_time_us":222294}
I20251215 20:52:58.629868 426 raft_consensus.cc:2272] T 894121edf7014daeaeb0e37428798ef1 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:58.629909 1686 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.631309 1714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:58.632234 3379 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.636123 1761 leader_election.cc:304] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.637338 3303 raft_consensus.cc:2804] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:58.637794 3303 raft_consensus.cc:697] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:58.638687 3303 consensus_queue.cc:237] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:58.639443 426 tablet_replica.cc:333] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.641366 426 raft_consensus.cc:2243] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.641928 426 raft_consensus.cc:2272] T c115c03783ff4ad588081a3566250c5f P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.645080 426 tablet_replica.cc:333] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.645459 3341 raft_consensus.cc:2749] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:58.645887 426 raft_consensus.cc:2243] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.646497 426 pending_rounds.cc:70] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:58.646763 426 pending_rounds.cc:77] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7232847726538006528 op_type: NO_OP noop_request { }
I20251215 20:52:58.647114 426 raft_consensus.cc:2889] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:58.647490 426 raft_consensus.cc:2272] T 16211cc39e2742beb0d2ef6ecc0a042b P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.651777 426 tablet_replica.cc:333] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.652536 426 raft_consensus.cc:2243] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.653187 426 raft_consensus.cc:2272] T ed49fbba2c19424aa9617a846079bcb3 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.653343 1761 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:58.655740 426 tablet_replica.cc:333] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.655792 3385 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:58.656874 426 raft_consensus.cc:2243] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.657424 426 raft_consensus.cc:2272] T e26493deab2c43b4ba30189716986767 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.666424 1544 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45280 (request call id 190) took 1815 ms. Trace:
I20251215 20:52:58.666983 1544 rpcz_store.cc:276] 1215 20:52:56.850661 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:56.850837 (+ 176us) service_pool.cc:225] Handling call
1215 20:52:58.666355 (+1815518us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:58.578056 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:58.578580 (+ 524us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:58.578613 (+ 33us) write_op.cc:435] Acquired schema lock
1215 20:52:58.578630 (+ 17us) tablet.cc:660] Decoding operations
1215 20:52:58.583231 (+ 4601us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:58.583305 (+ 74us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:58.583332 (+ 27us) tablet.cc:683] Acquiring locks for 7 operations
1215 20:52:58.583880 (+ 548us) tablet.cc:699] Row locks acquired
1215 20:52:58.583898 (+ 18us) write_op.cc:260] PREPARE: finished
1215 20:52:58.584016 (+ 118us) write_op.cc:270] Start()
1215 20:52:58.584122 (+ 106us) write_op.cc:276] Timestamp: P: 1765831978583981 usec, L: 0
1215 20:52:58.584143 (+ 21us) op_driver.cc:348] REPLICATION: starting
1215 20:52:58.599487 (+ 15344us) log.cc:844] Serialized 2869 byte log entry
1215 20:52:58.601337 (+ 1850us) op_driver.cc:464] REPLICATION: finished
1215 20:52:58.601727 (+ 390us) write_op.cc:301] APPLY: starting
1215 20:52:58.601802 (+ 75us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:58.601981 (+ 179us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:58.602074 (+ 93us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:58.602737 (+ 663us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:58.602920 (+ 183us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
1215 20:52:58.602964 (+ 44us) write_op.cc:312] APPLY: finished
1215 20:52:58.603185 (+ 221us) log.cc:844] Serialized 58 byte log entry
1215 20:52:58.603323 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:58.603436 (+ 113us) write_op.cc:454] Released schema lock
1215 20:52:58.603474 (+ 38us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:58.603749 (+ 275us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:58.603775 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":212,"apply.run_cpu_time_us":1994,"apply.run_wall_time_us":1993,"num_ops":7,"prepare.queue_time_us":43458,"prepare.run_cpu_time_us":3647,"prepare.run_wall_time_us":21706,"replication_time_us":17054,"thread_start_us":26631,"threads_started":1}]]}
I20251215 20:52:58.666493 426 tablet_replica.cc:333] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.673965 426 raft_consensus.cc:2243] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.674947 426 raft_consensus.cc:2272] T 247b9d40b010445d97b6159aa1916bf4 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.676566 1543 catalog_manager.cc:5654] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 4, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.682957 1543 catalog_manager.cc:5654] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 5 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:58.684346 426 tablet_replica.cc:333] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.684957 1543 catalog_manager.cc:5654] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
W20251215 20:52:58.686503 1760 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 317 similar messages]
I20251215 20:52:58.688149 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:58.688750 1787 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:58.686504 426 raft_consensus.cc:2243] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.693496 426 raft_consensus.cc:2272] T f25415c071bc4a8b9f638e653062455a P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.694073 1687 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.696791 426 tablet_replica.cc:333] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.698602 426 raft_consensus.cc:2243] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.699222 426 pending_rounds.cc:70] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:58.699529 426 pending_rounds.cc:77] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7232847723837431808 op_type: NO_OP noop_request { }
I20251215 20:52:58.699954 426 raft_consensus.cc:2889] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:58.700325 426 raft_consensus.cc:2272] T f8b4250dab5b409685b9c36ce1898c9b P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.702723 426 tablet_replica.cc:333] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.703464 426 raft_consensus.cc:2243] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.703969 426 raft_consensus.cc:2272] T 890b2cb838964cd4974f27cd401f1a01 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.686735 1543 catalog_manager.cc:5654] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 4, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.705158 2806 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:58.705534 2806 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:58.705824 2806 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:58.710296 1787 raft_consensus.cc:1275] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20251215 20:52:58.711910 1684 consensus_peers.cc:597] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e26493deab2c43b4ba30189716986767. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:58.713876 426 tablet_replica.cc:333] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.714290 2806 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.714632 426 raft_consensus.cc:2243] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.716641 426 pending_rounds.cc:70] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:58.705840 1543 catalog_manager.cc:5654] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.717073 426 pending_rounds.cc:77] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7232847724305010688 op_type: NO_OP noop_request { }
I20251215 20:52:58.717867 426 raft_consensus.cc:2889] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:58.717736 1543 catalog_manager.cc:5654] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 4 to 5, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 5 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.718436 426 raft_consensus.cc:2272] T 9bf291090f874d4ea5be3c23a51eea18 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.719496 1543 catalog_manager.cc:5654] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.721378 1543 catalog_manager.cc:5654] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 5, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 5 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:58.724572 2806 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.724138 1543 catalog_manager.cc:5654] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 4, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 4 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:58.725725 1543 catalog_manager.cc:5654] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 4, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 9b3367a5854f49b98da54556a209b0de (127.0.106.129). New cstate: current_term: 4 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
W20251215 20:52:58.727283 1686 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.726941 1543 catalog_manager.cc:5654] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9b3367a5854f49b98da54556a209b0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } }
I20251215 20:52:58.731688 3229 consensus_queue.cc:1048] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:58.733106 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e5d5ba56959418da34e0a6590f4c735" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:58.733623 1787 raft_consensus.cc:3060] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:58.740731 1686 consensus_peers.cc:597] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:58.741586 426 tablet_replica.cc:333] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.742426 426 raft_consensus.cc:2243] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.743259 426 raft_consensus.cc:2272] T df30f9d71a254842a4b64718482cdeb4 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.748792 1787 raft_consensus.cc:2468] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:52:58.749835 1687 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.750293 426 tablet_replica.cc:333] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.750819 3389 raft_consensus.cc:2804] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:58.751102 426 raft_consensus.cc:2243] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.751349 3389 raft_consensus.cc:697] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:58.752154 3389 consensus_queue.cc:237] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.755548 426 pending_rounds.cc:70] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: Trying to abort 1 pending ops.
I20251215 20:52:58.767064 3379 raft_consensus.cc:2955] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:58.768704 1789 raft_consensus.cc:2955] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:58.755853 426 pending_rounds.cc:77] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7232847719200210944 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "cd752a241baf44c3aa4fda90213e209f" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } } }
I20251215 20:52:58.769953 426 raft_consensus.cc:2917] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20251215 20:52:58.770300 426 raft_consensus.cc:2889] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20251215 20:52:58.770610 426 raft_consensus.cc:2272] T cd752a241baf44c3aa4fda90213e209f P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.772923 426 tablet_replica.cc:333] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.773874 426 raft_consensus.cc:2243] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.776993 426 raft_consensus.cc:2272] T 85dde241a3904afc914c383300a7cf6d P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.785051 426 tablet_replica.cc:333] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.786070 426 raft_consensus.cc:2243] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.785848 3303 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:58.787261 3303 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.789113 3303 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:58.789389 1759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 20:52:58.789754 1789 consensus_queue.cc:237] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:58.791793 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:58.792490 1712 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:58.795639 1761 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:58.797014 3357 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:58.797358 3357 raft_consensus.cc:493] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:58.797678 3357 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:58.802009 1760 leader_election.cc:336] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.813248 3357 raft_consensus.cc:515] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.786684 426 raft_consensus.cc:2272] T 0e8905748575496cb493cddc6f527786 P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.817800 426 tablet_replica.cc:333] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
W20251215 20:52:58.817852 1760 leader_election.cc:336] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.818909 426 raft_consensus.cc:2243] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.819620 3357 leader_election.cc:290] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:58.819849 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dab5221ac7fd4760b078481dd3a91eb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:58.820565 1712 raft_consensus.cc:3060] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:58.820770 1544 catalog_manager.cc:5654] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 2 to 3, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 3 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:58.823158 1544 catalog_manager.cc:5654] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 2 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:58.828881 1712 raft_consensus.cc:2468] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:52:58.830075 1761 leader_election.cc:304] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:58.831166 3357 raft_consensus.cc:2804] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:58.832118 3357 raft_consensus.cc:697] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:58.833029 3357 consensus_queue.cc:237] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.840857 1543 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45294 (request call id 187) took 1056 ms. Trace:
W20251215 20:52:58.846272 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:58.847245 1758 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997): Couldn't send request to peer fbfdeb011a604f78a77f04be26573717. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 890b2cb838964cd4974f27cd401f1a01. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:58.853062 1712 raft_consensus.cc:1275] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:52:58.837755 426 raft_consensus.cc:2272] T ae04951b92bc456ab7b716b990df02db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.844444 1543 rpcz_store.cc:276] 1215 20:52:57.784327 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 20:52:57.784437 (+ 110us) service_pool.cc:225] Handling call
1215 20:52:58.840798 (+1056361us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 20:52:58.757357 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 20:52:58.757846 (+ 489us) write_op.cc:432] Acquiring schema lock in shared mode
1215 20:52:58.757874 (+ 28us) write_op.cc:435] Acquired schema lock
1215 20:52:58.757889 (+ 15us) tablet.cc:660] Decoding operations
1215 20:52:58.758909 (+ 1020us) write_op.cc:620] Acquiring the partition lock for write op
1215 20:52:58.758970 (+ 61us) write_op.cc:641] Partition lock acquired for write op
1215 20:52:58.758998 (+ 28us) tablet.cc:683] Acquiring locks for 11 operations
1215 20:52:58.760414 (+ 1416us) tablet.cc:699] Row locks acquired
1215 20:52:58.760437 (+ 23us) write_op.cc:260] PREPARE: finished
1215 20:52:58.760580 (+ 143us) write_op.cc:270] Start()
1215 20:52:58.760691 (+ 111us) write_op.cc:276] Timestamp: P: 1765831978760527 usec, L: 0
1215 20:52:58.760711 (+ 20us) op_driver.cc:348] REPLICATION: starting
1215 20:52:58.761330 (+ 619us) log.cc:844] Serialized 4421 byte log entry
1215 20:52:58.765027 (+ 3697us) op_driver.cc:464] REPLICATION: finished
1215 20:52:58.765488 (+ 461us) write_op.cc:301] APPLY: starting
1215 20:52:58.765566 (+ 78us) tablet.cc:1365] starting BulkCheckPresence
1215 20:52:58.765777 (+ 211us) tablet.cc:1368] finished BulkCheckPresence
1215 20:52:58.765863 (+ 86us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 20:52:58.766765 (+ 902us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 20:52:58.766961 (+ 196us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
1215 20:52:58.767007 (+ 46us) write_op.cc:312] APPLY: finished
1215 20:52:58.767264 (+ 257us) log.cc:844] Serialized 82 byte log entry
1215 20:52:58.767410 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:58.767545 (+ 135us) write_op.cc:454] Released schema lock
1215 20:52:58.767591 (+ 46us) write_op.cc:341] FINISH: Updating metrics
1215 20:52:58.767880 (+ 289us) write_op.cc:489] Releasing partition, row and schema locks
1215 20:52:58.767908 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":266,"apply.run_cpu_time_us":2362,"apply.run_wall_time_us":2362,"num_ops":11,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":3892,"prepare.run_wall_time_us":4221,"replication_time_us":4191}]]}
I20251215 20:52:58.855384 3303 consensus_queue.cc:1048] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:52:58.857232 426 tablet_replica.cc:333] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.858016 426 raft_consensus.cc:2243] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.858924 426 raft_consensus.cc:2272] T f3f658260aa8496eab50a8b6eaa515e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.873548 1789 raft_consensus.cc:1275] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:52:58.874990 3379 consensus_queue.cc:1048] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:58.881843 426 tablet_replica.cc:333] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.882601 426 raft_consensus.cc:2243] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.883065 426 raft_consensus.cc:2272] T f226904c96ca4bddbd43673d79635bd7 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.893213 1544 catalog_manager.cc:5654] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index -1 to 3, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:58.894551 1544 catalog_manager.cc:5654] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 5 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:58.896337 1544 catalog_manager.cc:5654] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 4, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 4 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:58.902364 1544 catalog_manager.cc:5654] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 1 to 6, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 6 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:52:58.903946 1544 catalog_manager.cc:5654] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 5 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251215 20:52:58.906174 1686 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:58.915889 3303 raft_consensus.cc:2955] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:58.917174 426 tablet_replica.cc:333] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.917932 426 raft_consensus.cc:2243] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.918821 426 raft_consensus.cc:2272] T 8bd979146339464bb689a3bbf6826e47 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.925093 1712 raft_consensus.cc:2955] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:58.930685 426 tablet_replica.cc:333] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.931417 426 raft_consensus.cc:2243] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.931849 426 pending_rounds.cc:70] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Trying to abort 2 pending ops.
W20251215 20:52:58.932554 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20251215 20:52:58.944093 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:58.932036 426 pending_rounds.cc:77] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7232847765864869888 op_type: NO_OP noop_request { }
I20251215 20:52:58.956776 426 raft_consensus.cc:2889] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:58.957178 426 pending_rounds.cc:77] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7232847701387485184 op_type: NO_OP noop_request { }
I20251215 20:52:58.957571 426 raft_consensus.cc:2889] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 20:52:58.957933 426 raft_consensus.cc:2272] T f78523b75e1f4e8a937902c8178099db P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:58.960011 1592 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:58.960309 426 tablet_replica.cc:333] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:58.963757 1543 catalog_manager.cc:5654] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 1 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:52:58.971300 426 raft_consensus.cc:2243] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:58.971930 426 raft_consensus.cc:2272] T cbf9f34352854272976701e2b99044e6 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:58.974956 426 tablet_replica.cc:333] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
W20251215 20:52:58.979269 1592 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4e5d5ba56959418da34e0a6590f4c735, TS 95847161b0414d4e92d6cab94956fa57 -> TS fbfdeb011a604f78a77f04be26573717 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:58.990993 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4e5d5ba56959418da34e0a6590f4c735, TS 95847161b0414d4e92d6cab94956fa57 -> TS fbfdeb011a604f78a77f04be26573717 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:58.980599 1686 consensus_peers.cc:597] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:58.980526 1760 consensus_peers.cc:597] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:58.992875 3394 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:58.993379 3394 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:58.994005 1543 catalog_manager.cc:5654] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index -1 to 3, NON_VOTER fbfdeb011a604f78a77f04be26573717 (127.0.106.132) added. New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } } }
I20251215 20:52:58.995251 3394 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:58.997601 426 raft_consensus.cc:2243] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:52:58.997730 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:58.998442 1789 raft_consensus.cc:2393] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in current term 4: Already voted for candidate 95847161b0414d4e92d6cab94956fa57 in this term.
I20251215 20:52:58.998780 426 raft_consensus.cc:2272] T f587ca4384a3442e9dfef8a059e439e8 P 9b3367a5854f49b98da54556a209b0de [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:59.002977 426 tablet_replica.cc:333] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:59.012909 426 raft_consensus.cc:2243] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 6 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:59.013477 426 raft_consensus.cc:2272] T 2964497f848c4ff98a3846057a1f2528 P 9b3367a5854f49b98da54556a209b0de [term 6 FOLLOWER]: Raft consensus is shut down!
W20251215 20:52:59.011754 1592 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8e5a5566d2334d5f8f6829f319ce32af, TS be5dd78ebc024aefa4d17b3ccf2ea1ac -> TS fbfdeb011a604f78a77f04be26573717 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:59.013870 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8e5a5566d2334d5f8f6829f319ce32af, TS be5dd78ebc024aefa4d17b3ccf2ea1ac -> TS fbfdeb011a604f78a77f04be26573717 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:59.005091 1686 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:59.015295 1686 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:59.016040 3389 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:59.005432 1789 raft_consensus.cc:1275] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:52:59.018488 426 tablet_replica.cc:333] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:59.018568 3229 consensus_queue.cc:1048] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:59.019210 426 raft_consensus.cc:2243] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:59.024571 3389 raft_consensus.cc:2749] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:59.030824 426 raft_consensus.cc:2272] T f8fcddff0659452aad4ba12a1187579f P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:59.033154 426 tablet_replica.cc:333] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:59.033785 426 raft_consensus.cc:2243] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:59.034485 426 raft_consensus.cc:2272] T 668639c78eab435fb81c2471ddacf0db P 9b3367a5854f49b98da54556a209b0de [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:59.051358 426 tablet_replica.cc:333] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:59.052156 426 raft_consensus.cc:2243] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:52:59.053169 426 raft_consensus.cc:2272] T d45abd42bd074cfeb26d8617e4c3c8b2 P 9b3367a5854f49b98da54556a209b0de [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:59.055392 426 tablet_replica.cc:333] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de: stopping tablet replica
I20251215 20:52:59.055955 426 raft_consensus.cc:2243] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:52:59.064483 426 raft_consensus.cc:2272] T 15a0578355af497bb35215c17c067b09 P 9b3367a5854f49b98da54556a209b0de [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:52:59.076550 3229 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.077062 3229 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.079030 3229 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:59.080657 1760 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:59.085553 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:59.086099 1789 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:59.086920 1687 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:59.088986 3229 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:59.089437 3229 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.089854 3229 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:59.092527 1686 leader_election.cc:336] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:59.098249 3229 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.108634 3229 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:59.110417 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc2b2e8a3354bd186b3d721581fc8d2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:59.116010 1787 raft_consensus.cc:3060] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:59.112146 1686 leader_election.cc:336] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:59.121980 1787 raft_consensus.cc:2468] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:52:59.123523 1687 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:59.124207 3394 raft_consensus.cc:2804] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:59.124719 3394 raft_consensus.cc:697] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:59.125499 3394 consensus_queue.cc:237] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.149358 1712 raft_consensus.cc:1275] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20251215 20:52:59.150660 3424 consensus_queue.cc:1048] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:59.162212 1543 catalog_manager.cc:5654] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
W20251215 20:52:59.184584 1760 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:59.203588 1712 raft_consensus.cc:1275] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20251215 20:52:59.205222 3424 consensus_queue.cc:1048] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:59.206043 3440 ts_tablet_manager.cc:933] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:59.216760 1713 raft_consensus.cc:1275] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:52:59.219982 1789 raft_consensus.cc:1275] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20251215 20:52:59.221316 3229 consensus_queue.cc:1048] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:59.221357 3424 consensus_queue.cc:1048] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.002s
I20251215 20:52:59.221303 3440 tablet_copy_client.cc:323] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:37421
I20251215 20:52:59.225600 1731 tablet_copy_service.cc:140] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Received BeginTabletCopySession request for tablet e26493deab2c43b4ba30189716986767 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38116)
I20251215 20:52:59.226122 1731 tablet_copy_service.cc:161] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Beginning new tablet copy session on tablet e26493deab2c43b4ba30189716986767 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38116: session id = fbfdeb011a604f78a77f04be26573717-e26493deab2c43b4ba30189716986767
I20251215 20:52:59.250519 1731 tablet_copy_source_session.cc:215] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:59.255246 2319 raft_consensus.cc:3060] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 2 LEARNER]: Advancing to term 5
I20251215 20:52:59.255925 3440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26493deab2c43b4ba30189716986767. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:59.257622 1717 raft_consensus.cc:1275] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20251215 20:52:59.272396 3303 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20251215 20:52:59.277127 2319 raft_consensus.cc:1275] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 5 LEARNER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20251215 20:52:59.277415 2319 pending_rounds.cc:85] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Aborting all ops after (but not including) 2
I20251215 20:52:59.277591 2319 pending_rounds.cc:107] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20251215 20:52:59.277753 2319 raft_consensus.cc:2889] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:52:59.279214 3303 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251215 20:52:59.281175 1686 consensus_peers.cc:597] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:59.303762 1760 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:59.319080 3445 ts_tablet_manager.cc:933] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: Initiating tablet copy from peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:59.361562 3406 raft_consensus.cc:1064] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:52:59.361961 3406 raft_consensus.cc:1068] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: Unable to promote non-voter fbfdeb011a604f78a77f04be26573717: Illegal state: Leader has not yet committed an operation in its own term
W20251215 20:52:59.375936 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:59.417532 3440 tablet_copy_client.cc:806] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:59.424328 3445 tablet_copy_client.cc:323] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:45401
I20251215 20:52:59.423161 3440 tablet_copy_client.cc:670] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:59.436348 3440 tablet_copy_client.cc:538] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:59.436635 1805 tablet_copy_service.cc:140] P 95847161b0414d4e92d6cab94956fa57: Received BeginTabletCopySession request for tablet 890b2cb838964cd4974f27cd401f1a01 from peer fbfdeb011a604f78a77f04be26573717 ({username='slave'} at 127.0.0.1:38896)
I20251215 20:52:59.437201 1805 tablet_copy_service.cc:161] P 95847161b0414d4e92d6cab94956fa57: Beginning new tablet copy session on tablet 890b2cb838964cd4974f27cd401f1a01 from peer fbfdeb011a604f78a77f04be26573717 at {username='slave'} at 127.0.0.1:38896: session id = fbfdeb011a604f78a77f04be26573717-890b2cb838964cd4974f27cd401f1a01
I20251215 20:52:59.443912 1805 tablet_copy_source_session.cc:215] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: Tablet Copy: opened 0 blocks and 1 log segments
I20251215 20:52:59.453495 3445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890b2cb838964cd4974f27cd401f1a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:52:59.454025 3357 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.454596 3357 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.457161 3357 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:59.457383 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
W20251215 20:52:59.460075 1760 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:59.460477 1760 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:59.461894 3451 raft_consensus.cc:2749] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:59.483073 3450 raft_consensus.cc:1064] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:52:59.485513 3450 consensus_queue.cc:237] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:59.487031 3406 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.487563 3406 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:59.495045 3406 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:59.495329 1715 raft_consensus.cc:1275] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:52:59.497233 2320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:59.502514 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:59.502574 3406 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:59.508090 2319 raft_consensus.cc:1275] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 5 LEARNER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:52:59.510370 3406 consensus_queue.cc:1048] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:52:59.509202 1761 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
W20251215 20:52:59.513244 1760 leader_election.cc:336] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:59.514261 3424 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20251215 20:52:59.517596 1760 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:52:59.519110 3303 raft_consensus.cc:2955] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:59.526719 2320 raft_consensus.cc:2955] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:59.550249 3440 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
I20251215 20:52:59.550590 3229 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.551118 3229 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:59.553602 3229 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:52:59.554162 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:59.554500 2314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:52:59.554739 1787 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
W20251215 20:52:59.557044 1686 leader_election.cc:336] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:59.557466 1686 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de, fbfdeb011a604f78a77f04be26573717
I20251215 20:52:59.558562 3242 raft_consensus.cc:2749] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:52:59.559695 1715 raft_consensus.cc:2955] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:59.555706 3229 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.576902 3229 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:52:59.595867 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:59.601801 1686 leader_election.cc:336] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251215 20:52:59.605064 3229 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:59.605346 1542 catalog_manager.cc:5654] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 2 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:52:59.605867 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:59.613420 1687 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:59.616569 3229 raft_consensus.cc:2749] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:59.625885 3445 tablet_copy_client.cc:806] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 0 data blocks...
I20251215 20:52:59.626423 3445 tablet_copy_client.cc:670] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: tablet copy: Starting download of 1 WAL segments...
I20251215 20:52:59.633052 3445 tablet_copy_client.cc:538] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251215 20:52:59.640381 3452 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.640883 3452 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:59.643126 3452 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:59.646749 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:59.647061 1789 raft_consensus.cc:1275] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20251215 20:52:59.647459 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:59.648030 1787 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 4.
I20251215 20:52:59.648494 3229 consensus_queue.cc:1048] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:52:59.652336 1715 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 4.
I20251215 20:52:59.653609 2258 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters:
I20251215 20:52:59.657814 3452 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:59.664363 3452 raft_consensus.cc:493] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.683149 3452 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:59.682514 3445 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: Bootstrap starting.
W20251215 20:52:59.693867 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:52:59.697362 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:59.705085 3440 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:59.705958 3440 tablet_bootstrap.cc:492] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:59.706710 3440 ts_tablet_manager.cc:1403] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.157s user 0.024s sys 0.011s
I20251215 20:52:59.721743 3452 raft_consensus.cc:515] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:59.728242 3440 raft_consensus.cc:359] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:59.731647 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:59.731667 3440 raft_consensus.cc:740] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:59.732178 1715 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:59.732777 3440 consensus_queue.cc:260] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:59.738106 3440 ts_tablet_manager.cc:1434] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.031s user 0.000s sys 0.007s
I20251215 20:52:59.742424 1715 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 5.
I20251215 20:52:59.749224 1731 tablet_copy_service.cc:342] P be5dd78ebc024aefa4d17b3ccf2ea1ac: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-e26493deab2c43b4ba30189716986767 received from {username='slave'} at 127.0.0.1:38116
I20251215 20:52:59.749652 1731 tablet_copy_service.cc:434] P be5dd78ebc024aefa4d17b3ccf2ea1ac: ending tablet copy session fbfdeb011a604f78a77f04be26573717-e26493deab2c43b4ba30189716986767 on tablet e26493deab2c43b4ba30189716986767 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:59.745779 3452 leader_election.cc:290] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:59.749396 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46f5d70a2d6346c498b6686a9f4cb1c9" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:59.755544 1787 raft_consensus.cc:3060] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:59.756103 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:52:59.763059 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:59.772102 2257 leader_election.cc:336] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:52:59.773104 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:52:59.780802 2257 leader_election.cc:336] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.775679 1787 raft_consensus.cc:2468] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 5.
I20251215 20:52:59.782002 2258 leader_election.cc:304] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:59.782860 3452 raft_consensus.cc:2804] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:59.785028 3452 raft_consensus.cc:697] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 5 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:52:59.785902 3452 consensus_queue.cc:237] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:52:59.789197 3450 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.789688 3450 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.791453 3450 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:59.791692 3242 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.792194 3242 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.794179 3242 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:59.799067 1686 leader_election.cc:336] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.799849 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:59.799959 3450 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.800486 3450 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.801841 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:59.802035 1687 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:59.802668 3303 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.802590 3450 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:52:59.807668 1760 leader_election.cc:336] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.807479 3303 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.809442 3303 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:59.810545 3229 raft_consensus.cc:2749] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:52:59.812563 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:59.812885 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:59.815248 3445 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:52:59.816149 3445 tablet_bootstrap.cc:492] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: Bootstrap complete.
I20251215 20:52:59.816828 3445 ts_tablet_manager.cc:1403] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: Time spent bootstrapping tablet: real 0.135s user 0.023s sys 0.003s
W20251215 20:52:59.818441 1760 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.819653 3303 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:52:59.821319 3303 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.822209 1760 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:59.823959 3303 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:59.824673 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:59.825302 1717 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
I20251215 20:52:59.826220 3303 raft_consensus.cc:2749] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:52:59.826664 1761 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:59.827978 1761 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:59.829283 3450 raft_consensus.cc:2749] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:52:59.829960 3450 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:59.829223 1544 catalog_manager.cc:5654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 5 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:52:59.830276 3450 raft_consensus.cc:493] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:52:59.830637 3450 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:59.829454 3242 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.832435 3242 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.834340 3242 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:59.836985 1760 leader_election.cc:336] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.837417 1760 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:59.838068 3303 raft_consensus.cc:2749] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20251215 20:52:59.841275 1686 leader_election.cc:336] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.842270 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:59.843077 3450 raft_consensus.cc:515] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.843861 1789 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:52:59.845373 1687 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:59.846836 3242 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:52:59.847186 3242 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
W20251215 20:52:59.847751 1760 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.847476 3445 raft_consensus.cc:359] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:59.848330 3445 raft_consensus.cc:740] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Initialized, Role: LEARNER
I20251215 20:52:59.847543 3242 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:59.851497 3450 leader_election.cc:290] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:52:59.852887 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fb924e2d4664d11b09b8aa8eccab15d" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:52:59.854423 1717 raft_consensus.cc:3060] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:52:59.855468 1760 leader_election.cc:336] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.859985 3242 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.848982 3445 consensus_queue.cc:260] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: true } }
I20251215 20:52:59.870673 3242 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:59.860404 1717 raft_consensus.cc:2468] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
W20251215 20:52:59.875710 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:52:59.878197 3445 ts_tablet_manager.cc:1434] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: Time spent starting tablet: real 0.058s user 0.006s sys 0.000s
I20251215 20:52:59.879761 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "894121edf7014daeaeb0e37428798ef1" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:52:59.880409 1787 raft_consensus.cc:3060] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:52:59.880452 1761 leader_election.cc:304] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:59.881476 3303 raft_consensus.cc:2804] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:59.881913 3303 raft_consensus.cc:697] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:52:59.882684 3303 consensus_queue.cc:237] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.886142 1805 tablet_copy_service.cc:342] P 95847161b0414d4e92d6cab94956fa57: Request end of tablet copy session fbfdeb011a604f78a77f04be26573717-890b2cb838964cd4974f27cd401f1a01 received from {username='slave'} at 127.0.0.1:38896
I20251215 20:52:59.886533 1805 tablet_copy_service.cc:434] P 95847161b0414d4e92d6cab94956fa57: ending tablet copy session fbfdeb011a604f78a77f04be26573717-890b2cb838964cd4974f27cd401f1a01 on tablet 890b2cb838964cd4974f27cd401f1a01 with peer fbfdeb011a604f78a77f04be26573717
I20251215 20:52:59.895843 1787 raft_consensus.cc:2468] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:52:59.908162 1687 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:52:59.910203 3229 raft_consensus.cc:2804] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:52:59.910657 3229 raft_consensus.cc:697] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:52:59.911402 3229 consensus_queue.cc:237] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.913973 1544 catalog_manager.cc:5654] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 5 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
W20251215 20:52:59.925853 1686 leader_election.cc:336] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:52:59.927068 1760 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:59.927536 1760 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251215 20:52:59.947750 1544 catalog_manager.cc:5654] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
W20251215 20:52:59.949267 1760 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:52:59.949281 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20251215 20:52:59.967301 3303 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.967800 3303 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:52:59.969619 3303 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:52:59.970845 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:52:59.971552 3229 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.971560 1715 raft_consensus.cc:2393] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95847161b0414d4e92d6cab94956fa57 in current term 6: Already voted for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in this term.
I20251215 20:52:59.972079 3229 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.973909 3229 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:52:59.977905 1760 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.978406 1760 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:52:59.979110 3303 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Advancing to term 6
W20251215 20:52:59.980039 1686 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:52:59.982651 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:59.983238 1789 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:52:59.984141 1687 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:52:59.985082 3229 raft_consensus.cc:2804] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:52:59.985420 3229 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.985762 3229 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:52:59.989457 3303 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:52:59.991868 3242 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:52:59.992370 3242 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.992374 3229 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:52:59.994169 3242 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:52:59.995057 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:52:59.999042 1789 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
W20251215 20:52:59.998881 1686 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.001019 1686 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.001739 1687 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.002439 3242 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:53:00.002781 3242 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.003093 3242 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:53:00.005185 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f9efe5a0bab4fb78f99bca3470e9bb4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.005722 1787 raft_consensus.cc:3060] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:53:00.009761 3242 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.012629 3450 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.013131 3450 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.014925 3450 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.015596 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f3342ae83724ded89bf01a1e27047be" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.016111 1786 raft_consensus.cc:3060] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:53:00.021612 1760 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.022150 1686 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.022468 3451 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.022975 3451 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.024135 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.024833 3451 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.026032 1761 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:00.026611 1787 raft_consensus.cc:2468] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:53:00.027710 1687 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.027803 3394 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.023445 1786 raft_consensus.cc:2468] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:53:00.028328 3394 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.029062 3424 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:53:00.029488 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.030033 1715 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:53:00.030225 3394 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.030965 3394 raft_consensus.cc:2804] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:53:00.032132 3394 raft_consensus.cc:697] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.033217 3394 consensus_queue.cc:237] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:53:00.038290 1760 leader_election.cc:336] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.039077 1686 leader_election.cc:336] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.000523 3229 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.043217 3242 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.046507 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:00.047739 1761 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.048764 3303 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:53:00.049125 3303 raft_consensus.cc:493] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.049444 3303 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:53:00.057041 1687 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.058151 1687 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.057456 1544 catalog_manager.cc:5654] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 3 to 4, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:00.060547 3394 raft_consensus.cc:2804] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:53:00.061061 3394 raft_consensus.cc:697] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.061568 3229 raft_consensus.cc:2749] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:53:00.061944 3394 consensus_queue.cc:237] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.055969 3303 raft_consensus.cc:515] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.068122 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25415c071bc4a8b9f638e653062455a" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:53:00.068645 1715 raft_consensus.cc:3060] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:53:00.070340 3242 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.071038 3242 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.073210 3242 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.077139 3303 leader_election.cc:290] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.078913 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:53:00.082396 1760 leader_election.cc:336] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.088862 3303 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.089356 3303 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.091971 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.092537 1717 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 2.
I20251215 20:53:00.093331 1761 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:53:00.094121 3451 raft_consensus.cc:2804] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:53:00.094468 3451 raft_consensus.cc:493] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.094800 3451 raft_consensus.cc:3060] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:53:00.096524 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.099265 3303 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.099802 1715 raft_consensus.cc:2468] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
W20251215 20:53:00.100195 1760 leader_election.cc:336] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.093291 1686 leader_election.cc:336] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.101759 1686 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 95847161b0414d4e92d6cab94956fa57, 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.101954 3451 raft_consensus.cc:515] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.103221 3242 raft_consensus.cc:2749] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:53:00.105415 1761 leader_election.cc:304] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.106575 3424 raft_consensus.cc:2804] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:53:00.107038 3424 raft_consensus.cc:697] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:53:00.107784 3424 consensus_queue.cc:237] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.108629 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30f9d71a254842a4b64718482cdeb4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:53:00.109138 1717 raft_consensus.cc:3060] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:00.110435 3451 leader_election.cc:290] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.118486 3464 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.119016 3464 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.121106 1717 raft_consensus.cc:2468] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:53:00.121996 3242 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.122104 1761 leader_election.cc:304] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:53:00.122586 3242 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.126529 3451 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.126721 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:00.127029 3451 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.127349 1789 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 3.
I20251215 20:53:00.128619 1687 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:53:00.129482 3229 raft_consensus.cc:2804] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:53:00.122953 3303 raft_consensus.cc:2804] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:53:00.129843 3229 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.130265 3229 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:53:00.130146 3303 raft_consensus.cc:697] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:53:00.131323 3303 consensus_queue.cc:237] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.123595 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:00.134711 1786 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:53:00.124099 3464 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.136559 3451 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.137249 3242 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.137528 3229 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.139338 3229 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.150343 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b9d40b010445d97b6159aa1916bf4" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.150369 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.151031 1789 raft_consensus.cc:3060] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:53:00.151669 1544 catalog_manager.cc:5654] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 4, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 4 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:00.152844 1543 catalog_manager.cc:5654] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:00.157750 1789 raft_consensus.cc:2468] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:53:00.158802 1687 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:53:00.168095 3468 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:53:00.168498 3468 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.168843 3468 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:53:00.168219 1687 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:53:00.174255 3229 raft_consensus.cc:2804] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:53:00.174692 3229 raft_consensus.cc:697] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.175446 3229 consensus_queue.cc:237] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.180527 1543 catalog_manager.cc:5654] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 2 to 3, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:00.175619 3468 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.189695 3468 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.191524 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f658260aa8496eab50a8b6eaa515e6" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.192077 1786 raft_consensus.cc:3060] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:53:00.195020 1760 leader_election.cc:336] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.196862 3468 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.197330 3468 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.199084 3468 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.199980 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:00.200697 1789 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
W20251215 20:53:00.201406 1686 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.201732 1687 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:53:00.202385 1686 leader_election.cc:336] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.202991 3394 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20251215 20:53:00.203284 3394 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.203572 3394 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:53:00.209951 3394 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.211647 3394 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.213171 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85dde241a3904afc914c383300a7cf6d" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.213723 1789 raft_consensus.cc:3060] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Advancing to term 6
W20251215 20:53:00.214387 1686 leader_election.cc:336] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.216450 1786 raft_consensus.cc:2468] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:53:00.211714 1543 catalog_manager.cc:5654] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 3 to 4, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:00.221905 1760 leader_election.cc:336] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.223614 1760 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:00.224243 3424 raft_consensus.cc:2749] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:53:00.226969 1687 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:53:00.227679 3394 raft_consensus.cc:2804] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:53:00.228266 3394 raft_consensus.cc:697] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.229041 1789 raft_consensus.cc:2468] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 6.
W20251215 20:53:00.230165 1686 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.232223 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.236438 1687 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:53:00.240653 3229 raft_consensus.cc:2804] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Leader election won for term 6
I20251215 20:53:00.236670 3394 consensus_queue.cc:237] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.241147 3229 raft_consensus.cc:697] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.241926 3229 consensus_queue.cc:237] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.250223 3468 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.250694 3468 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.252521 3468 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.253361 3303 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.253844 3303 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:53:00.255458 2257 consensus_peers.cc:597] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:00.255899 3303 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.257378 1787 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:00.257946 1787 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:53:00.262841 1687 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
W20251215 20:53:00.264323 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.264850 3468 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:53:00.265283 3468 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.265641 3468 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:53:00.260696 1686 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.266417 1686 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.274919 1760 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.275024 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.279367 1787 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20251215 20:53:00.280889 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:00.281337 1686 leader_election.cc:336] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.281929 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.286473 1713 raft_consensus.cc:1275] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:53:00.286659 3303 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.287114 3303 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.289305 3303 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.290340 1761 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:00.284009 3468 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.292349 3424 raft_consensus.cc:2749] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:53:00.292766 3468 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.294636 3424 consensus_queue.cc:1048] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:53:00.284667 3452 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20251215 20:53:00.299567 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8bd979146339464bb689a3bbf6826e47" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.296667 1713 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.300086 1786 raft_consensus.cc:3060] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:53:00.300966 1713 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 3.
I20251215 20:53:00.306145 1761 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters:
I20251215 20:53:00.306756 3451 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.306864 3303 raft_consensus.cc:2804] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:53:00.307556 3303 raft_consensus.cc:493] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.307274 3451 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.307961 3303 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:53:00.309517 3451 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.306910 1786 raft_consensus.cc:2468] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:53:00.315997 2320 raft_consensus.cc:1217] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
W20251215 20:53:00.319250 1686 leader_election.cc:336] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.320952 1760 leader_election.cc:336] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.334215 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.334874 1717 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:53:00.338320 2320 raft_consensus.cc:1217] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.2->[4.3-4.3] Dedup: 4.3->[]
I20251215 20:53:00.336553 1543 catalog_manager.cc:5654] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:00.346062 1760 leader_election.cc:336] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.349756 1761 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.350900 3451 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20251215 20:53:00.351256 3451 raft_consensus.cc:493] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.351616 3451 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:53:00.352186 3424 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.352708 3424 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.354516 3424 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.327709 3303 raft_consensus.cc:515] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.358122 3303 leader_election.cc:290] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:00.361012 1686 consensus_peers.cc:597] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:00.367024 1760 leader_election.cc:336] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.367587 1760 leader_election.cc:336] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.369709 3451 raft_consensus.cc:515] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.376056 1687 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.378764 3394 raft_consensus.cc:2804] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:53:00.379221 3394 raft_consensus.cc:697] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.380007 3394 consensus_queue.cc:237] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.384193 3451 leader_election.cc:290] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.385926 1542 catalog_manager.cc:5654] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 5 to 6, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 6 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:00.396339 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae04951b92bc456ab7b716b990df02db" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:53:00.387655 1713 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20251215 20:53:00.396876 1712 raft_consensus.cc:3060] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Advancing to term 4
W20251215 20:53:00.401856 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.404265 1712 raft_consensus.cc:2468] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 4.
W20251215 20:53:00.388808 1760 leader_election.cc:336] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.389909 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.393307 1786 raft_consensus.cc:1275] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:53:00.406067 1715 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f587ca4384a3442e9dfef8a059e439e8" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:53:00.406567 1715 raft_consensus.cc:3060] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:53:00.406852 3453 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:53:00.412377 1715 raft_consensus.cc:2468] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 6.
I20251215 20:53:00.414033 1761 leader_election.cc:304] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.417896 1761 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:53:00.420118 1760 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:00.419960 3450 raft_consensus.cc:2804] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:53:00.420025 3468 consensus_queue.cc:1048] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20251215 20:53:00.421818 3450 raft_consensus.cc:697] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:53:00.422797 1761 leader_election.cc:304] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.422643 3450 consensus_queue.cc:237] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.423812 3357 raft_consensus.cc:2804] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Leader election won for term 6
I20251215 20:53:00.424235 3357 raft_consensus.cc:697] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 6 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:53:00.425024 3357 consensus_queue.cc:237] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.428323 3229 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:00.428791 3229 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:53:00.430565 3229 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:53:00.442625 1544 catalog_manager.cc:5654] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:00.442423 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:00.446210 1791 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 6.
I20251215 20:53:00.427495 3451 raft_consensus.cc:2749] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:53:00.454949 3424 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:00.458155 3424 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.459939 3424 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.461416 3242 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.469713 3394 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.470227 3394 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.472028 3394 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.461905 3242 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.479480 3242 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:53:00.485725 1760 leader_election.cc:336] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.493119 1686 consensus_peers.cc:597] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:00.493573 1686 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.499864 1686 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.504992 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 61868.7us
I20251215 20:53:00.509351 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:00.509955 1789 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:53:00.511077 1542 catalog_manager.cc:5654] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 4, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 4 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:00.512044 1712 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" is_pre_election: true
I20251215 20:53:00.512612 1712 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 5.
I20251215 20:53:00.512637 1542 catalog_manager.cc:5654] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 5 to 6, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 6 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:00.513608 1687 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.514344 3229 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20251215 20:53:00.514696 3229 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:00.514997 3229 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Advancing to term 7
I20251215 20:53:00.517273 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:00.517887 1791 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 4.
I20251215 20:53:00.519222 1791 raft_consensus.cc:1275] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:53:00.520773 1791 raft_consensus.cc:1275] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:53:00.522585 3229 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
W20251215 20:53:00.524714 1686 leader_election.cc:336] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:00.525158 2258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 80530.5us
W20251215 20:53:00.525657 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:00.534482 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:00.537014 1760 consensus_peers.cc:597] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:00.527029 1761 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.544816 3483 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20251215 20:53:00.546559 1786 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2964497f848c4ff98a3846057a1f2528" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.529524 3229 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 7 election: Requested vote from peers 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:53:00.548732 1786 raft_consensus.cc:3060] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Advancing to term 7
W20251215 20:53:00.564013 1686 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.579435 1687 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:53:00.590955 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.595738 1786 raft_consensus.cc:2468] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 7.
I20251215 20:53:00.596153 3483 raft_consensus.cc:493] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:00.598778 3483 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Advancing to term 6
W20251215 20:53:00.602794 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.606851 3483 raft_consensus.cc:515] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.611164 3483 leader_election.cc:290] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:00.611779 2320 consensus_queue.cc:237] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:53:00.616700 1760 leader_election.cc:336] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.616847 1786 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20251215 20:53:00.618294 3453 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251215 20:53:00.621136 3468 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:53:00.621541 3468 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.621917 3468 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:53:00.622272 1687 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.623032 3242 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:53:00.623371 3242 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b3367a5854f49b98da54556a209b0de)
I20251215 20:53:00.623703 3242 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:53:00.627079 3453 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:00.630369 3242 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.628814 3468 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.629570 1786 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:00.632308 3242 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:00.633101 3229 consensus_queue.cc:1048] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251215 20:53:00.633351 3394 consensus_queue.cc:1048] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20251215 20:53:00.638571 1686 consensus_peers.cc:597] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:00.639083 1686 consensus_peers.cc:597] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:00.633708 3468 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Requested vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
W20251215 20:53:00.642503 1686 leader_election.cc:336] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.650856 1687 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
W20251215 20:53:00.651791 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.652601 3229 raft_consensus.cc:2804] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 7 FOLLOWER]: Leader election won for term 7
I20251215 20:53:00.653107 3229 raft_consensus.cc:697] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 7 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.652972 1542 catalog_manager.cc:5654] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: config changed from index 3 to 6, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New cstate: current_term: 5 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:00.654315 1791 raft_consensus.cc:1275] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20251215 20:53:00.656049 1791 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8fcddff0659452aad4ba12a1187579f" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.658464 1791 raft_consensus.cc:3060] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:53:00.653913 3229 consensus_queue.cc:237] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:53:00.664628 1789 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45abd42bd074cfeb26d8617e4c3c8b2" candidate_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
I20251215 20:53:00.665154 1789 raft_consensus.cc:3060] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:53:00.671988 1789 raft_consensus.cc:2468] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:53:00.673328 1786 raft_consensus.cc:1275] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20251215 20:53:00.678453 426 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1667)
I20251215 20:53:00.683024 1791 raft_consensus.cc:2468] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd78ebc024aefa4d17b3ccf2ea1ac in term 5.
I20251215 20:53:00.688022 1712 raft_consensus.cc:1275] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20251215 20:53:00.691255 1714 raft_consensus.cc:1275] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20251215 20:53:00.651759 1686 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.690047 1715 raft_consensus.cc:1275] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:00.691525 1542 catalog_manager.cc:5654] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 5 to 7, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 7 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:00.688045 1530 catalog_manager.cc:4712] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 46f5d70a2d6346c498b6686a9f4cb1c9: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:00.705765 1528 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 46f5d70a2d6346c498b6686a9f4cb1c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:53:00.705750 1717 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23db9937c6294006a7fac93aa519bad4" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac"
I20251215 20:53:00.706471 1717 raft_consensus.cc:3060] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Advancing to term 6
I20251215 20:53:00.730008 1717 raft_consensus.cc:2468] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95847161b0414d4e92d6cab94956fa57 in term 6.
I20251215 20:53:00.738260 3481 consensus_queue.cc:1048] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251215 20:53:00.750697 3464 raft_consensus.cc:1064] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
W20251215 20:53:00.752923 1760 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:00.753299 3464 consensus_queue.cc:237] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 1, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:53:00.762868 1686 consensus_peers.cc:597] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:00.773797 3424 raft_consensus.cc:1064] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: attempting to promote NON_VOTER fbfdeb011a604f78a77f04be26573717 to VOTER
I20251215 20:53:00.777630 3424 consensus_queue.cc:237] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:00.781378 1687 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.781622 3487 consensus_queue.cc:1048] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:00.782657 3242 raft_consensus.cc:2804] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:53:00.783177 3242 raft_consensus.cc:697] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.784018 3242 consensus_queue.cc:237] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.787695 3303 consensus_queue.cc:1048] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:00.788923 3483 consensus_queue.cc:1048] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:00.790014 3229 consensus_queue.cc:1048] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:00.791478 1687 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.792179 3488 raft_consensus.cc:2804] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:53:00.794107 3488 raft_consensus.cc:697] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Becoming Leader. State: Replica: be5dd78ebc024aefa4d17b3ccf2ea1ac, State: Running, Role: LEADER
I20251215 20:53:00.794912 3488 consensus_queue.cc:237] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.800539 1761 leader_election.cc:304] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, be5dd78ebc024aefa4d17b3ccf2ea1ac; no voters: 9b3367a5854f49b98da54556a209b0de
I20251215 20:53:00.801318 3483 raft_consensus.cc:2804] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Leader election won for term 6
I20251215 20:53:00.801863 3483 raft_consensus.cc:697] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 6 LEADER]: Becoming Leader. State: Replica: 95847161b0414d4e92d6cab94956fa57, State: Running, Role: LEADER
I20251215 20:53:00.803972 3483 consensus_queue.cc:237] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:00.811612 1717 raft_consensus.cc:2955] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:00.858781 1714 raft_consensus.cc:1275] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:53:00.897503 1542 catalog_manager.cc:5654] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:00.914443 2320 raft_consensus.cc:1275] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 [term 3 LEARNER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251215 20:53:00.917182 1792 raft_consensus.cc:1275] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:53:00.920239 1544 catalog_manager.cc:5654] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 reported cstate change: term changed from 3 to 6, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to 95847161b0414d4e92d6cab94956fa57 (127.0.106.131). New cstate: current_term: 6 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:00.921541 3483 consensus_queue.cc:1048] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251215 20:53:00.925432 2320 raft_consensus.cc:1275] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 LEARNER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:53:00.927887 3488 consensus_queue.cc:1048] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20251215 20:53:00.939286 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:00.944686 1712 raft_consensus.cc:1275] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251215 20:53:00.945994 3357 consensus_queue.cc:1048] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:00.946364 3229 consensus_queue.cc:1048] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20251215 20:53:00.956383 1760 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:00.961318 1760 consensus_peers.cc:597] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:00.962545 1792 raft_consensus.cc:1275] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:53:00.966099 3450 consensus_queue.cc:1048] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20251215 20:53:00.971771 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:00.972107 1791 raft_consensus.cc:1275] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20251215 20:53:00.997303 1714 raft_consensus.cc:1275] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20251215 20:53:01.002480 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251215 20:53:01.014462 3488 consensus_queue.cc:1048] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20251215 20:53:01.018896 3488 consensus_queue.cc:1048] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:01.022048 3503 consensus_queue.cc:1048] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20251215 20:53:01.029453 1686 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:01.030200 1686 consensus_peers.cc:597] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:01.032807 1686 consensus_peers.cc:597] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:01.042059 1686 consensus_peers.cc:597] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:01.062328 3242 raft_consensus.cc:2955] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 3 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.070029 1791 raft_consensus.cc:2955] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.091935 1544 catalog_manager.cc:5654] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: term changed from 4 to 5, leader changed from 9b3367a5854f49b98da54556a209b0de (127.0.106.129) to be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130). New cstate: current_term: 5 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:01.108162 3510 log.cc:927] Time spent T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20251215 20:53:01.113037 2319 raft_consensus.cc:2955] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.139135 1544 catalog_manager.cc:5654] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 3 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } attrs { replace: true } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.150244 3424 raft_consensus.cc:2955] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.174908 1720 consensus_queue.cc:237] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:01.181602 2319 raft_consensus.cc:1275] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20251215 20:53:01.183097 3242 consensus_queue.cc:1048] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:53:01.182725 1714 raft_consensus.cc:2955] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.191251 3229 raft_consensus.cc:2955] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.200981 1792 raft_consensus.cc:1275] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20251215 20:53:01.209770 1531 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet e26493deab2c43b4ba30189716986767 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251215 20:53:01.213496 2320 raft_consensus.cc:2955] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.211922 2319 raft_consensus.cc:2955] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
I20251215 20:53:01.228699 3504 consensus_queue.cc:1048] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:53:01.233984 1787 raft_consensus.cc:1275] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 7 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20251215 20:53:01.242393 1542 catalog_manager.cc:5654] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 reported cstate change: config changed from index 3 to 4, fbfdeb011a604f78a77f04be26573717 (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "95847161b0414d4e92d6cab94956fa57" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
W20251215 20:53:01.244140 1686 consensus_peers.cc:597] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:01.254664 3504 consensus_queue.cc:1048] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251215 20:53:01.255358 1544 catalog_manager.cc:5654] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac reported cstate change: config changed from index 4 to 5, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New cstate: current_term: 4 leader_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251215 20:53:01.256516 1791 raft_consensus.cc:2955] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 9b3367a5854f49b98da54556a209b0de (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } } }
W20251215 20:53:01.296432 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20251215 20:53:01.306105 1714 raft_consensus.cc:1275] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Refusing update from remote peer 95847161b0414d4e92d6cab94956fa57: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20251215 20:53:01.326692 3424 consensus_queue.cc:1048] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:01.331544 1792 raft_consensus.cc:1275] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20251215 20:53:01.347628 1792 raft_consensus.cc:1275] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer be5dd78ebc024aefa4d17b3ccf2ea1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20251215 20:53:01.353127 3487 consensus_queue.cc:1048] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:53:01.354346 3487 consensus_queue.cc:1048] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251215 20:53:01.397204 1686 consensus_peers.cc:597] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:01.417361 1760 consensus_peers.cc:597] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:01.426262 1686 consensus_peers.cc:597] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:01.522428 1760 consensus_peers.cc:597] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:01.551040 1686 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:01.622321 1686 consensus_peers.cc:597] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:01.680680 1760 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:01.681625 426 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:01.737360 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:01.844846 1686 consensus_peers.cc:597] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:01.855568 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:01.952112 1530 catalog_manager.cc:4712] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e26493deab2c43b4ba30189716986767: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:01.969648 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:01.969918 1760 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:02.012562 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:02.167119 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:02.169425 1760 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:02.171983 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:02.229339 1760 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:02.236537 1760 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:02.344821 1760 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:02.417851 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:02.431025 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:02.474890 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:02.582751 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:02.617056 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:02.664845 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:02.671742 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:02.682086 426 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:02.801363 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:02.890007 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:02.942476 1686 consensus_peers.cc:597] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:02.955389 1686 consensus_peers.cc:597] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:02.966084 1686 consensus_peers.cc:597] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.013226 1760 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.025832 1686 consensus_peers.cc:597] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.048882 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.066150 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.100447 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.114555 1530 catalog_manager.cc:4712] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 46f5d70a2d6346c498b6686a9f4cb1c9: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:03.130936 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.158538 1760 consensus_peers.cc:597] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.190656 1760 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.205704 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.231150 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.265741 1760 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.363027 1686 consensus_peers.cc:597] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.362697 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.396189 1686 consensus_peers.cc:597] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.444156 1686 consensus_peers.cc:597] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.501439 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.540676 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.624148 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:03.654340 1686 consensus_peers.cc:597] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.661307 1760 consensus_peers.cc:597] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.662451 1686 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.682654 426 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:03.705240 1686 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111) [suppressed 537 similar messages]
W20251215 20:53:03.818588 1760 consensus_peers.cc:597] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:03.904071 1760 consensus_peers.cc:597] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:03.966526 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:04.097186 1686 consensus_peers.cc:597] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:04.105649 1686 consensus_peers.cc:597] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:04.112682 1686 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:04.116591 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:04.231781 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:04.335000 1760 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:04.377794 1686 consensus_peers.cc:597] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:04.486886 1760 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:04.506876 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:04.593784 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:04.595678 1760 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:04.650974 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:04.661096 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:04.683140 426 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:04.688095 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:04.700044 1686 consensus_peers.cc:597] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:04.736063 1760 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:04.801709 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:04.863853 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:04.957358 1760 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:05.056164 1760 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:05.115366 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:05.137825 1686 consensus_peers.cc:597] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.212703 1760 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.235417 1530 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.106.129:38541, user_credentials={real_user=slave}} blocked reactor thread for 56113.5us
W20251215 20:53:05.238479 1530 catalog_manager.cc:4712] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 46f5d70a2d6346c498b6686a9f4cb1c9: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:05.276530 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.304821 1686 consensus_peers.cc:597] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.334700 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:05.369766 1686 consensus_peers.cc:597] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:05.406697 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.441905 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.459906 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.482684 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.517181 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.521867 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.533546 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.550879 1760 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.611076 1686 consensus_peers.cc:597] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.621276 1760 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.683564 426 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:05.710171 1686 consensus_peers.cc:597] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.726629 1686 consensus_peers.cc:597] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.733469 1760 consensus_peers.cc:597] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.750494 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.808955 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.814172 1686 consensus_peers.cc:597] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.855597 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:05.927527 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:05.963025 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:06.065472 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:06.075953 1760 consensus_peers.cc:597] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:06.189314 1686 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:06.253527 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:06.322700 1686 consensus_peers.cc:597] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:06.344623 1760 consensus_peers.cc:597] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:06.387164 1686 consensus_peers.cc:597] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:06.499933 1760 consensus_peers.cc:597] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:06.684017 426 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:06.693333 1686 consensus_peers.cc:597] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251215 20:53:06.738210 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:06.832839 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:06.845077 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:06.856484 1760 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:06.864050 1686 consensus_peers.cc:597] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:06.922072 1686 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.069423 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:07.146957 1686 consensus_peers.cc:597] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.150152 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:07.167312 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:07.216980 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:07.325469 1760 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.384230 1760 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.406982 1760 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:07.414496 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:07.457139 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.510696 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:07.634541 1760 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:07.649194 1686 consensus_peers.cc:597] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.654351 1760 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:07.684821 426 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:07.735777 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:07.776598 1686 consensus_peers.cc:597] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.868158 1686 consensus_peers.cc:597] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.874486 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:07.901717 1760 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:07.946509 1686 consensus_peers.cc:597] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:07.988428 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.058359 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.092705 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.101111 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.143273 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.144673 1760 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:08.152873 1686 consensus_peers.cc:597] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:08.167865 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.170342 1686 consensus_peers.cc:597] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:08.187733 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.219812 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.249828 1686 consensus_peers.cc:597] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:08.267843 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.272847 1760 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:08.374940 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:08.398274 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:08.427219 1760 consensus_peers.cc:597] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:08.685274 426 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:08.795373 2257 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111) [suppressed 498 similar messages]
W20251215 20:53:09.225150 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:09.347266 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 72730us
W20251215 20:53:09.473294 1530 catalog_manager.cc:4712] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 46f5d70a2d6346c498b6686a9f4cb1c9: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:09.488596 1686 consensus_peers.cc:597] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:09.502638 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:09.520962 1686 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:09.525386 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:09.528450 1760 consensus_peers.cc:597] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:09.602497 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:09.660024 1686 consensus_peers.cc:597] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:09.686403 426 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:09.735036 1760 consensus_peers.cc:597] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:09.762837 1760 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:09.766637 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:09.897682 1686 consensus_peers.cc:597] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:09.905823 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:09.924605 1760 consensus_peers.cc:597] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20251215 20:53:09.979843 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:10.006398 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:10.034631 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:10.067885 1686 consensus_peers.cc:597] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.213076 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.220775 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:10.275570 1816 debug-util.cc:398] Leaking SignalData structure 0x7b08001cfe60 after lost signal to thread 429
W20251215 20:53:10.276646 1816 debug-util.cc:398] Leaking SignalData structure 0x7b0800199500 after lost signal to thread 1578
W20251215 20:53:10.277778 1816 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0e20 after lost signal to thread 1745
W20251215 20:53:10.278740 1816 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd640 after lost signal to thread 1819
W20251215 20:53:10.279788 1816 debug-util.cc:398] Leaking SignalData structure 0x7b0800126940 after lost signal to thread 2345
W20251215 20:53:10.405928 1760 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.425788 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:10.434805 1686 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.439106 1686 consensus_peers.cc:597] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.456377 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:10.555610 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:10.587698 1686 consensus_peers.cc:597] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.633884 1760 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:10.686861 426 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:10.696765 1686 consensus_peers.cc:597] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.725623 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:10.740578 1686 consensus_peers.cc:597] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.798866 1760 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:10.864645 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:10.992182 1686 consensus_peers.cc:597] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:10.993145 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:11.345844 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:11.360802 1686 consensus_peers.cc:597] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:11.514398 1686 consensus_peers.cc:597] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:11.514842 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:11.556341 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:11.558528 1686 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:11.599185 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:11.607721 1686 consensus_peers.cc:597] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:11.687322 426 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:11.833745 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:11.857828 1686 consensus_peers.cc:597] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.006989 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.008466 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:12.020510 1760 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:12.022590 1760 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.024041 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.024530 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.024957 1760 consensus_peers.cc:597] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.025784 1760 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.026243 1760 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.027047 1760 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.027582 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.228826 1686 consensus_peers.cc:597] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.266479 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.302162 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.310356 1687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45401, user_credentials={real_user=slave}} blocked reactor thread for 71801.6us
W20251215 20:53:12.526764 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.531175 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.534209 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.627753 1760 consensus_peers.cc:597] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.631294 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:12.659451 1686 consensus_peers.cc:597] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:12.671492 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:12.676578 1760 consensus_peers.cc:597] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:12.687783 426 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:12.831377 1686 consensus_peers.cc:597] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:12.831861 1760 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:12.834638 1686 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:12.837569 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:12.869436 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:12.983438 1686 consensus_peers.cc:597] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:13.139261 1760 consensus_peers.cc:597] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20251215 20:53:13.143280 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:13.196852 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:13.230239 1686 consensus_peers.cc:597] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:13.236701 1686 consensus_peers.cc:597] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:13.260696 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 46400.1us
W20251215 20:53:13.276942 1686 consensus_peers.cc:597] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:13.288527 1686 consensus_peers.cc:597] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:13.299875 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:13.310154 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:13.313907 1760 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:13.548647 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:13.688372 426 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:13.717520 1686 consensus_peers.cc:597] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:13.760756 1760 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:13.809692 1686 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111) [suppressed 473 similar messages]
W20251215 20:53:13.813402 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:13.831710 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:13.944485 1686 consensus_peers.cc:597] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:13.968152 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:13.991084 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:14.038837 1686 consensus_peers.cc:597] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:14.048175 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:14.070642 1686 consensus_peers.cc:597] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.116911 1760 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.126819 1686 consensus_peers.cc:597] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:14.186448 1760 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:14.246853 1760 consensus_peers.cc:597] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.509299 1686 consensus_peers.cc:597] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:14.530226 1686 consensus_peers.cc:597] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.535619 1686 consensus_peers.cc:597] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.571714 1761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:37421, user_credentials={real_user=slave}} blocked reactor thread for 114391us
W20251215 20:53:14.577260 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:14.577950 1760 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.578532 1760 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.585615 1760 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:14.585963 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:14.592434 1686 consensus_peers.cc:597] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:14.612242 1686 consensus_peers.cc:597] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:14.614907 1760 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.688863 426 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 1667)
W20251215 20:53:14.904349 1686 consensus_peers.cc:597] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:14.908533 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:14.997411 1760 consensus_peers.cc:597] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:15.018733 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:15.065300 1686 consensus_peers.cc:597] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:15.083632 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:15.102487 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:15.147823 1686 consensus_peers.cc:597] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:15.178014 1686 consensus_peers.cc:597] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:15.236955 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20251215 20:53:15.264381 1742 debug-util.cc:398] Leaking SignalData structure 0x7b08003461e0 after lost signal to thread 429
W20251215 20:53:15.265426 1742 debug-util.cc:398] Leaking SignalData structure 0x7b080037a900 after lost signal to thread 1578
W20251215 20:53:15.266646 1742 debug-util.cc:398] Leaking SignalData structure 0x7b080016ab00 after lost signal to thread 1745
W20251215 20:53:15.268668 1742 debug-util.cc:398] Leaking SignalData structure 0x7b080016a2a0 after lost signal to thread 1819
W20251215 20:53:15.269814 1742 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5e00 after lost signal to thread 2345
W20251215 20:53:15.361507 1760 consensus_peers.cc:597] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:15.440148 1686 consensus_peers.cc:597] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:15.448362 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20251215 20:53:15.478597 1686 consensus_peers.cc:597] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:15.502466 1760 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:15.568681 1686 consensus_peers.cc:597] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:15.572098 1760 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:15.607764 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20251215 20:53:15.614894 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:15.636055 1686 consensus_peers.cc:597] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:15.643666 1761 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.645504 1761 consensus_peers.cc:597] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.655297 1761 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.665416 1761 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.675623 1761 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.683000 2258 consensus_peers.cc:597] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.683748 2258 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.696868 1761 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.701058 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:53:15.705354 426 tablet_replica.cc:333] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.706319 426 raft_consensus.cc:2243] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.710166 426 raft_consensus.cc:2272] T 0bb86f5c9ae14081b0e0633dacbfcb59 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.710692 1686 consensus_peers.cc:597] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:15.711337 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20251215 20:53:15.713662 426 tablet_replica.cc:333] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.714627 426 raft_consensus.cc:2243] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.715242 426 raft_consensus.cc:2272] T 8e5a5566d2334d5f8f6829f319ce32af P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.718011 426 tablet_replica.cc:333] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.718816 426 raft_consensus.cc:2243] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.719738 426 raft_consensus.cc:2272] T cffb60a2970e4e049f29999509c860aa P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.722252 1761 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.722389 426 tablet_replica.cc:333] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.723242 426 raft_consensus.cc:2243] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.724262 426 raft_consensus.cc:2272] T 40b5b64d429c4a079403980321090051 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.726778 426 tablet_replica.cc:333] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.727586 426 raft_consensus.cc:2243] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.728197 426 raft_consensus.cc:2272] T a434313be259487d9537e911635a6d90 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.730885 426 tablet_replica.cc:333] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.731707 426 raft_consensus.cc:2243] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus shutting down.
W20251215 20:53:15.732321 2258 consensus_peers.cc:597] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.732498 426 raft_consensus.cc:2272] T 7403a55fe6fa41268e8b54130c9e785d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.735272 426 tablet_replica.cc:333] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.736081 426 raft_consensus.cc:2243] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.737167 426 raft_consensus.cc:2272] T 113c523599f94be28a277e199067cf22 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.740702 426 tablet_replica.cc:333] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.742340 426 raft_consensus.cc:2243] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.744940 426 raft_consensus.cc:2272] T 037b6406285a4af8bec65f6a1fdfca12 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.746276 1686 consensus_peers.cc:597] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:15.748957 426 tablet_replica.cc:333] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.749779 426 raft_consensus.cc:2243] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.750342 426 raft_consensus.cc:2272] T dcd94ac4984a4f7f855158085913f825 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.752724 426 tablet_replica.cc:333] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.753458 426 raft_consensus.cc:2243] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.754055 426 raft_consensus.cc:2272] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.755347 1761 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.756486 426 tablet_replica.cc:333] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.757359 426 raft_consensus.cc:2243] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.758347 426 raft_consensus.cc:2272] T b28e18dcf749433caf5edc863540ec32 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.761080 426 tablet_replica.cc:333] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.761838 426 raft_consensus.cc:2243] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.762348 426 raft_consensus.cc:2272] T 98273a1b4c27409fbf35f33b10ca80f0 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.764667 426 tablet_replica.cc:333] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.765415 426 raft_consensus.cc:2243] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.766489 426 raft_consensus.cc:2272] T 4e5d5ba56959418da34e0a6590f4c735 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.769007 426 tablet_replica.cc:333] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.769753 426 raft_consensus.cc:2243] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.770627 426 raft_consensus.cc:2272] T 10e7dc78d083418c9f49bb4450d426f7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.773743 426 tablet_replica.cc:333] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.774498 426 raft_consensus.cc:2243] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.774933 426 raft_consensus.cc:2272] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.776943 426 tablet_replica.cc:333] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.777565 426 raft_consensus.cc:2243] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.778067 426 raft_consensus.cc:2272] T 2f04d2e58d7b495fa12144051af83ae1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.780031 426 tablet_replica.cc:333] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.780673 426 raft_consensus.cc:2243] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.781134 426 raft_consensus.cc:2272] T b6292c3ac4394235a8d94502dcb65913 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.783030 426 tablet_replica.cc:333] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.783954 426 raft_consensus.cc:2243] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.784818 426 raft_consensus.cc:2272] T 2355bff2629046d8aedcfc2f63a52c18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.787065 426 tablet_replica.cc:333] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.787737 426 raft_consensus.cc:2243] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.788384 426 raft_consensus.cc:2272] T 810b825e4fe44036ba77841772e5192f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.790709 426 tablet_replica.cc:333] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
W20251215 20:53:15.791244 1686 consensus_peers.cc:597] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:15.791917 426 raft_consensus.cc:2243] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.792631 426 raft_consensus.cc:2272] T dab5221ac7fd4760b078481dd3a91eb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.794853 426 tablet_replica.cc:333] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.795336 426 raft_consensus.cc:2243] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.796250 426 raft_consensus.cc:2272] T 2bc2b2e8a3354bd186b3d721581fc8d2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.798250 426 tablet_replica.cc:333] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.798965 426 raft_consensus.cc:2243] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.800005 426 raft_consensus.cc:2272] T 9f3342ae83724ded89bf01a1e27047be P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.802361 426 tablet_replica.cc:333] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.803073 426 raft_consensus.cc:2243] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.803632 426 raft_consensus.cc:2272] T 23db9937c6294006a7fac93aa519bad4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.805971 426 tablet_replica.cc:333] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.806480 426 raft_consensus.cc:2243] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.807030 426 raft_consensus.cc:2272] T 46f5d70a2d6346c498b6686a9f4cb1c9 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.809281 426 tablet_replica.cc:333] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.809911 426 raft_consensus.cc:2243] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Raft consensus shutting down.
W20251215 20:53:15.810652 2258 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.810837 426 raft_consensus.cc:2272] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.812812 426 tablet_replica.cc:333] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.813352 426 raft_consensus.cc:2243] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.813798 426 raft_consensus.cc:2272] T 6fb924e2d4664d11b09b8aa8eccab15d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.815652 426 tablet_replica.cc:333] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.816248 426 raft_consensus.cc:2243] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.817076 426 raft_consensus.cc:2272] T 894121edf7014daeaeb0e37428798ef1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.819142 426 tablet_replica.cc:333] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.819756 426 raft_consensus.cc:2243] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.820708 426 raft_consensus.cc:2272] T c115c03783ff4ad588081a3566250c5f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.822299 2258 consensus_peers.cc:597] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.823022 426 tablet_replica.cc:333] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.823552 426 raft_consensus.cc:2243] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.823994 426 raft_consensus.cc:2272] T 16211cc39e2742beb0d2ef6ecc0a042b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.825935 426 tablet_replica.cc:333] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.826454 426 raft_consensus.cc:2243] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.827212 426 raft_consensus.cc:2272] T 0e8905748575496cb493cddc6f527786 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.829180 426 tablet_replica.cc:333] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.829864 426 raft_consensus.cc:2243] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.831156 426 raft_consensus.cc:2272] T 86d34bd4c9884678a883bfc6fe5393a8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.833669 426 tablet_replica.cc:333] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.834318 426 raft_consensus.cc:2243] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.835071 426 raft_consensus.cc:2272] T e26493deab2c43b4ba30189716986767 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.836985 426 tablet_replica.cc:333] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.837566 426 raft_consensus.cc:2243] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.838372 426 raft_consensus.cc:2272] T 247b9d40b010445d97b6159aa1916bf4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.840617 426 tablet_replica.cc:333] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.841291 426 raft_consensus.cc:2243] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.842001 426 raft_consensus.cc:2272] T e1388514310d41f78bca30dd0dac6f46 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.842061 1761 consensus_peers.cc:597] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.844017 426 tablet_replica.cc:333] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.844548 426 raft_consensus.cc:2243] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.845019 426 raft_consensus.cc:2272] T f25415c071bc4a8b9f638e653062455a P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.847234 426 tablet_replica.cc:333] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.847934 426 raft_consensus.cc:2243] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.849156 426 raft_consensus.cc:2272] T 668639c78eab435fb81c2471ddacf0db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.851485 426 tablet_replica.cc:333] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.852164 426 raft_consensus.cc:2243] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.852727 426 raft_consensus.cc:2272] T 9bf291090f874d4ea5be3c23a51eea18 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.853464 1761 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.854702 426 tablet_replica.cc:333] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.855242 426 raft_consensus.cc:2243] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.855721 426 raft_consensus.cc:2272] T df30f9d71a254842a4b64718482cdeb4 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.857599 426 tablet_replica.cc:333] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.858057 426 raft_consensus.cc:2243] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.858806 426 raft_consensus.cc:2272] T 85dde241a3904afc914c383300a7cf6d P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.860684 426 tablet_replica.cc:333] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.861155 426 raft_consensus.cc:2243] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.862166 426 raft_consensus.cc:2272] T cd752a241baf44c3aa4fda90213e209f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.864344 426 tablet_replica.cc:333] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.865061 426 raft_consensus.cc:2243] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.866039 426 raft_consensus.cc:2272] T d45abd42bd074cfeb26d8617e4c3c8b2 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.868227 426 tablet_replica.cc:333] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.868803 426 raft_consensus.cc:2243] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.869338 426 raft_consensus.cc:2272] T f587ca4384a3442e9dfef8a059e439e8 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.871379 426 tablet_replica.cc:333] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.872074 426 raft_consensus.cc:2243] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.872593 426 raft_consensus.cc:2272] T a7d99999ba4f49a28d840d50bcdcaa16 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.874601 426 tablet_replica.cc:333] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.875139 426 raft_consensus.cc:2243] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.875586 426 raft_consensus.cc:2272] T 5f91c85f57504082af247cc60403edd1 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.877466 426 tablet_replica.cc:333] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.878023 426 raft_consensus.cc:2243] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.878715 426 raft_consensus.cc:2272] T f8b4250dab5b409685b9c36ce1898c9b P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.880756 426 tablet_replica.cc:333] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.881240 426 raft_consensus.cc:2243] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.881789 426 raft_consensus.cc:2272] T 890b2cb838964cd4974f27cd401f1a01 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.883796 426 tablet_replica.cc:333] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.884222 426 raft_consensus.cc:2243] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.884665 426 raft_consensus.cc:2272] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.886873 426 tablet_replica.cc:333] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.887555 426 raft_consensus.cc:2243] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.887993 426 raft_consensus.cc:2272] T 15a0578355af497bb35215c17c067b09 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.890094 426 tablet_replica.cc:333] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.890751 426 raft_consensus.cc:2243] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.891500 426 raft_consensus.cc:2272] T f3f658260aa8496eab50a8b6eaa515e6 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.893718 426 tablet_replica.cc:333] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.894372 426 raft_consensus.cc:2243] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.894898 426 raft_consensus.cc:2272] T f226904c96ca4bddbd43673d79635bd7 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 2 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.895689 1761 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.897161 426 tablet_replica.cc:333] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.897887 426 raft_consensus.cc:2243] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
W20251215 20:53:15.898703 1761 consensus_peers.cc:597] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.898928 426 raft_consensus.cc:2272] T 8bd979146339464bb689a3bbf6826e47 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.901026 426 tablet_replica.cc:333] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.901573 426 raft_consensus.cc:2243] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.902132 426 raft_consensus.cc:2272] T f78523b75e1f4e8a937902c8178099db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.904572 426 tablet_replica.cc:333] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.905196 426 raft_consensus.cc:2243] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:15.905790 426 raft_consensus.cc:2272] T ae04951b92bc456ab7b716b990df02db P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.907258 1761 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.907764 1760 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:15.907905 1761 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:15.908119 426 tablet_replica.cc:333] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.908799 426 raft_consensus.cc:2243] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 7 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.909754 426 raft_consensus.cc:2272] T 2964497f848c4ff98a3846057a1f2528 P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 7 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:15.912221 426 tablet_replica.cc:333] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac: stopping tablet replica
I20251215 20:53:15.912863 426 raft_consensus.cc:2243] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:15.914264 426 raft_consensus.cc:2272] T f8fcddff0659452aad4ba12a1187579f P be5dd78ebc024aefa4d17b3ccf2ea1ac [term 5 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:15.956169 1761 consensus_peers.cc:597] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.961485 1760 consensus_peers.cc:597] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:15.967548 1761 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.973002 1761 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:15.983279 2257 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:15.995204 1761 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.008819 1761 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.077008 1761 consensus_peers.cc:597] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.077828 2258 consensus_peers.cc:597] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.089709 1761 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.110370 2258 consensus_peers.cc:597] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.138720 1761 consensus_peers.cc:597] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.156041 1760 consensus_peers.cc:597] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20251215 20:53:16.170130 1760 consensus_peers.cc:597] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:16.176110 1761 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.196715 1761 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.197743 2257 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:16.223330 1761 consensus_peers.cc:597] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:16.273538 1760 consensus_peers.cc:597] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:16.413880 1760 consensus_peers.cc:597] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:16.495721 1760 consensus_peers.cc:597] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:16.544586 2257 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20251215 20:53:16.581658 1760 consensus_peers.cc:597] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20251215 20:53:16.588191 1760 consensus_peers.cc:597] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20251215 20:53:16.779275 3585 raft_consensus.cc:493] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:16.779917 3585 raft_consensus.cc:515] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:16.782310 3585 leader_election.cc:290] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:16.786214 1761 leader_election.cc:336] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
W20251215 20:53:16.786718 1760 leader_election.cc:336] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:16.787132 1760 leader_election.cc:304] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:16.787719 3585 raft_consensus.cc:2749] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251215 20:53:16.793557 1760 consensus_peers.cc:597] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:16.795653 1760 consensus_peers.cc:597] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:16.808537 3585 raft_consensus.cc:493] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:16.808995 3585 raft_consensus.cc:515] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:16.810858 3585 leader_election.cc:290] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:16.815332 1760 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:16.816661 1761 leader_election.cc:336] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:16.817046 1761 leader_election.cc:304] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:16.817685 3585 raft_consensus.cc:2749] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20251215 20:53:16.849473 1760 consensus_peers.cc:597] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20251215 20:53:16.939378 3585 raft_consensus.cc:493] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:16.939894 3585 raft_consensus.cc:515] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:16.941756 3585 leader_election.cc:290] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:16.942494 3589 raft_consensus.cc:493] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:16.943023 3589 raft_consensus.cc:515] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:53:16.946841 1761 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
W20251215 20:53:16.947335 1760 leader_election.cc:336] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:16.947714 1760 leader_election.cc:304] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:16.948239 3589 leader_election.cc:290] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:16.948904 3589 raft_consensus.cc:2749] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20251215 20:53:16.952900 1761 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
W20251215 20:53:16.953611 1760 leader_election.cc:336] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:16.953980 1760 leader_election.cc:304] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:16.955021 3585 raft_consensus.cc:2749] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:53:16.956740 3585 raft_consensus.cc:493] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:16.957231 3585 raft_consensus.cc:515] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:16.958956 3585 leader_election.cc:290] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:16.962321 1761 leader_election.cc:336] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
W20251215 20:53:16.962766 1760 leader_election.cc:336] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:16.963173 1760 leader_election.cc:304] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:16.963829 3585 raft_consensus.cc:2749] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:53:16.965056 3585 raft_consensus.cc:493] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:16.965476 3585 raft_consensus.cc:515] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } }
I20251215 20:53:16.967170 3585 leader_election.cc:290] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541)
I20251215 20:53:16.968881 3589 raft_consensus.cc:493] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:16.969619 3589 raft_consensus.cc:515] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:16.971546 3589 leader_election.cc:290] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:16.974160 1760 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:16.974615 1761 leader_election.cc:336] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:16.975839 1761 leader_election.cc:304] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:16.976548 3589 raft_consensus.cc:2749] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20251215 20:53:16.976855 1760 leader_election.cc:336] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:16.978622 1761 leader_election.cc:336] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:16.978917 1761 leader_election.cc:304] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:16.979394 3585 raft_consensus.cc:2749] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:53:16.984685 3585 raft_consensus.cc:493] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:16.985168 3585 raft_consensus.cc:515] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:16.988481 3585 leader_election.cc:290] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:16.992097 1761 leader_election.cc:336] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
W20251215 20:53:16.996623 1760 leader_election.cc:336] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:16.997097 1760 leader_election.cc:304] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:16.997786 3589 raft_consensus.cc:2749] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:53:17.024271 3589 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.024780 3589 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:17.026860 3589 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
I20251215 20:53:17.027829 2318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
W20251215 20:53:17.029738 1761 leader_election.cc:336] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.030743 1758 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:53:17.031424 3585 raft_consensus.cc:493] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.031867 3585 raft_consensus.cc:515] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:17.032315 3584 raft_consensus.cc:2749] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:53:17.033725 3585 leader_election.cc:290] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:17.034597 3587 raft_consensus.cc:493] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.035079 3587 raft_consensus.cc:515] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:17.037007 3587 leader_election.cc:290] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.041743 426 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1742)
W20251215 20:53:17.042695 2257 leader_election.cc:336] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.043597 3585 raft_consensus.cc:493] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:53:17.044219 1760 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.044106 3585 raft_consensus.cc:515] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:53:17.045068 2258 leader_election.cc:336] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.045456 2258 leader_election.cc:304] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.046111 3585 leader_election.cc:290] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:17.046190 3588 raft_consensus.cc:2749] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:53:17.046823 1761 leader_election.cc:336] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.047240 1761 leader_election.cc:304] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
W20251215 20:53:17.047418 1760 consensus_peers.cc:597] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:17.047945 3585 raft_consensus.cc:2749] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20251215 20:53:17.049957 1760 leader_election.cc:336] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.051525 3588 raft_consensus.cc:493] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:53:17.051662 1761 leader_election.cc:336] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.052105 1761 leader_election.cc:304] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.052019 3588 raft_consensus.cc:515] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:17.052764 3585 raft_consensus.cc:2749] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:53:17.053701 3588 leader_election.cc:290] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.057646 2257 leader_election.cc:336] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:17.059316 2258 leader_election.cc:336] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.059760 2258 leader_election.cc:304] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.060431 3588 raft_consensus.cc:2749] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:53:17.071103 3585 raft_consensus.cc:493] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.071643 3585 raft_consensus.cc:515] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:17.073616 3585 leader_election.cc:290] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
I20251215 20:53:17.075542 3585 raft_consensus.cc:493] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
W20251215 20:53:17.077134 1761 leader_election.cc:336] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.081403 3585 raft_consensus.cc:515] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:17.086330 3585 leader_election.cc:290] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.087926 1760 leader_election.cc:336] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.088619 1760 leader_election.cc:304] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.089725 3584 raft_consensus.cc:2749] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251215 20:53:17.091217 1761 leader_election.cc:336] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.091677 3588 raft_consensus.cc:493] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.092214 3588 raft_consensus.cc:515] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:53:17.092573 1760 leader_election.cc:336] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.093078 1760 leader_election.cc:304] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.094225 3588 leader_election.cc:290] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.096149 1760 consensus_peers.cc:597] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:17.094329 3585 raft_consensus.cc:2749] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20251215 20:53:17.097311 2257 leader_election.cc:336] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:17.101526 2258 leader_election.cc:336] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.101833 2258 leader_election.cc:304] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.102483 3588 raft_consensus.cc:2749] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:53:17.114151 3584 raft_consensus.cc:493] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.114665 3584 raft_consensus.cc:515] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:17.116343 3584 leader_election.cc:290] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.121096 1760 leader_election.cc:336] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.123287 3584 raft_consensus.cc:493] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.123646 3584 raft_consensus.cc:515] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:17.125615 3584 leader_election.cc:290] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.129402 1760 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:17.131525 1761 leader_election.cc:336] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.131935 1761 leader_election.cc:304] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.132658 3584 raft_consensus.cc:2749] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251215 20:53:17.133478 3584 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.134004 3584 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
W20251215 20:53:17.136116 1761 leader_election.cc:336] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.136580 1761 leader_election.cc:304] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.137163 2318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "95847161b0414d4e92d6cab94956fa57" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbfdeb011a604f78a77f04be26573717" is_pre_election: true
I20251215 20:53:17.137902 3585 raft_consensus.cc:2749] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:53:17.138661 3584 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), fbfdeb011a604f78a77f04be26573717 (127.0.106.132:44997)
W20251215 20:53:17.143337 1761 leader_election.cc:336] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.143714 1761 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac, fbfdeb011a604f78a77f04be26573717
I20251215 20:53:17.145102 3584 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:53:17.146589 1760 leader_election.cc:336] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:17.149219 1760 consensus_peers.cc:597] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20251215 20:53:17.149614 1760 consensus_peers.cc:597] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:17.165699 3588 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.166277 3588 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:17.168444 3588 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:17.171449 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
W20251215 20:53:17.172008 2258 leader_election.cc:336] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.172051 1793 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 4.
I20251215 20:53:17.174139 2258 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.174847 3588 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251215 20:53:17.175232 3588 raft_consensus.cc:493] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.175570 3588 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Advancing to term 5
I20251215 20:53:17.182991 3588 raft_consensus.cc:515] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:17.186161 3585 raft_consensus.cc:493] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.186659 3585 raft_consensus.cc:515] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:17.187945 3588 leader_election.cc:290] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 election: Requested vote from peers be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:17.188539 3585 leader_election.cc:290] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.189003 2258 leader_election.cc:336] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.191174 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e26493deab2c43b4ba30189716986767" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57"
W20251215 20:53:17.192830 1761 leader_election.cc:336] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.193919 1793 raft_consensus.cc:3060] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Advancing to term 5
W20251215 20:53:17.194705 1760 leader_election.cc:336] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.197788 1760 leader_election.cc:304] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.198477 3584 raft_consensus.cc:2749] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:53:17.202755 1793 raft_consensus.cc:2468] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 5.
I20251215 20:53:17.205456 2258 leader_election.cc:304] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.207573 3588 raft_consensus.cc:2804] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Leader election won for term 5
I20251215 20:53:17.208050 3588 raft_consensus.cc:697] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 5 LEADER]: Becoming Leader. State: Replica: fbfdeb011a604f78a77f04be26573717, State: Running, Role: LEADER
I20251215 20:53:17.208962 3588 consensus_queue.cc:237] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:17.224515 1544 catalog_manager.cc:5654] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 reported cstate change: term changed from 4 to 5, leader changed from be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130) to fbfdeb011a604f78a77f04be26573717 (127.0.106.132). New cstate: current_term: 5 leader_uuid: "fbfdeb011a604f78a77f04be26573717" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251215 20:53:17.230494 1760 consensus_peers.cc:597] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20251215 20:53:17.241698 3584 raft_consensus.cc:493] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.242182 3584 raft_consensus.cc:515] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:17.243820 3584 leader_election.cc:290] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.247514 1760 leader_election.cc:336] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:17.248942 1761 leader_election.cc:336] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.249302 1761 leader_election.cc:304] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.249894 3584 raft_consensus.cc:2749] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:53:17.274272 3584 raft_consensus.cc:493] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.274863 3584 raft_consensus.cc:515] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
I20251215 20:53:17.276528 3584 leader_election.cc:290] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.279841 1761 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
W20251215 20:53:17.282615 1760 leader_election.cc:336] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.282961 1760 leader_election.cc:304] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.283493 3584 raft_consensus.cc:2749] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20251215 20:53:17.302415 3584 raft_consensus.cc:493] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.302838 3584 raft_consensus.cc:515] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } }
W20251215 20:53:17.304548 2257 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20251215 20:53:17.308413 1761 leader_election.cc:336] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
I20251215 20:53:17.306674 3584 leader_election.cc:290] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421)
W20251215 20:53:17.311882 1760 leader_election.cc:336] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.312335 1760 leader_election.cc:304] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.312870 3584 raft_consensus.cc:2749] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251215 20:53:17.347896 3588 raft_consensus.cc:493] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be5dd78ebc024aefa4d17b3ccf2ea1ac)
I20251215 20:53:17.348378 3588 raft_consensus.cc:515] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9b3367a5854f49b98da54556a209b0de" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 38541 } } peers { permanent_uuid: "be5dd78ebc024aefa4d17b3ccf2ea1ac" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37421 } attrs { replace: true } } peers { permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 } } peers { permanent_uuid: "fbfdeb011a604f78a77f04be26573717" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 44997 } attrs { promote: false } }
I20251215 20:53:17.350296 3588 leader_election.cc:290] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541), be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421), 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401)
I20251215 20:53:17.352555 1793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd752a241baf44c3aa4fda90213e209f" candidate_uuid: "fbfdeb011a604f78a77f04be26573717" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95847161b0414d4e92d6cab94956fa57" is_pre_election: true
I20251215 20:53:17.353629 1793 raft_consensus.cc:2468] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfdeb011a604f78a77f04be26573717 in term 2.
W20251215 20:53:17.354378 2258 leader_election.cc:336] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111)
W20251215 20:53:17.356079 2257 leader_election.cc:336] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:17.356492 2257 leader_election.cc:304] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95847161b0414d4e92d6cab94956fa57, fbfdeb011a604f78a77f04be26573717; no voters: 9b3367a5854f49b98da54556a209b0de, be5dd78ebc024aefa4d17b3ccf2ea1ac
I20251215 20:53:17.357749 3588 raft_consensus.cc:2749] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 20:53:17.450371 1760 consensus_peers.cc:597] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:17.500427 1760 consensus_peers.cc:597] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20251215 20:53:17.655189 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
W20251215 20:53:17.689844 1530 catalog_manager.cc:4712] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 46f5d70a2d6346c498b6686a9f4cb1c9: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
W20251215 20:53:17.728164 1760 consensus_peers.cc:597] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:17.734275 1760 consensus_peers.cc:597] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:17.740634 1788 raft_consensus.cc:1275] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Refusing update from remote peer fbfdeb011a604f78a77f04be26573717: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20251215 20:53:17.741883 3579 consensus_queue.cc:1048] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95847161b0414d4e92d6cab94956fa57" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20251215 20:53:17.755983 2258 consensus_peers.cc:597] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:17.764827 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
W20251215 20:53:17.768702 1592 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:53:17.768970 1592 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251215 20:53:17.787958 2258 consensus_peers.cc:597] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:17.804507 2258 consensus_peers.cc:597] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:17.804638 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:53:17.805395 426 tablet_replica.cc:333] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.805945 426 raft_consensus.cc:2243] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.806396 426 raft_consensus.cc:2272] T e1388514310d41f78bca30dd0dac6f46 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.808107 426 tablet_replica.cc:333] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.808673 426 raft_consensus.cc:2243] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.809065 426 raft_consensus.cc:2272] T 8350524f9e4a49929464adde48de2442 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.811048 426 tablet_replica.cc:333] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.811731 426 raft_consensus.cc:2243] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.812516 426 raft_consensus.cc:2272] T 8e5a5566d2334d5f8f6829f319ce32af P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.814277 426 tablet_replica.cc:333] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.814738 426 raft_consensus.cc:2243] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.815121 426 raft_consensus.cc:2272] T 113c523599f94be28a277e199067cf22 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.817139 426 tablet_replica.cc:333] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.817703 426 raft_consensus.cc:2243] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 6 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.818542 426 raft_consensus.cc:2272] T a434313be259487d9537e911635a6d90 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.820344 426 tablet_replica.cc:333] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.820909 426 raft_consensus.cc:2243] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.821763 426 raft_consensus.cc:2272] T 59398fb5c6c84abd94ba4b8ee8ad4d6f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.823660 426 tablet_replica.cc:333] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.824191 426 raft_consensus.cc:2243] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.824604 426 raft_consensus.cc:2272] T b28e18dcf749433caf5edc863540ec32 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.826031 426 tablet_replica.cc:333] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.827025 426 raft_consensus.cc:2243] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.827697 426 raft_consensus.cc:2272] T 98273a1b4c27409fbf35f33b10ca80f0 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.829283 426 tablet_replica.cc:333] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.829800 426 raft_consensus.cc:2243] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.830348 426 raft_consensus.cc:2272] T 4e5d5ba56959418da34e0a6590f4c735 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.832213 426 tablet_replica.cc:333] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
W20251215 20:53:17.832392 1760 consensus_peers.cc:597] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20251215 20:53:17.832932 426 raft_consensus.cc:2243] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.833609 426 raft_consensus.cc:2272] T 037b6406285a4af8bec65f6a1fdfca12 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.835183 426 tablet_replica.cc:333] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.835652 426 raft_consensus.cc:2243] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.836335 426 raft_consensus.cc:2272] T dcd94ac4984a4f7f855158085913f825 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.837826 426 tablet_replica.cc:333] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.838254 426 raft_consensus.cc:2243] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.838773 426 raft_consensus.cc:2272] T e26493deab2c43b4ba30189716986767 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.840680 426 tablet_replica.cc:333] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.841360 426 raft_consensus.cc:2243] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.841754 426 raft_consensus.cc:2272] T 247b9d40b010445d97b6159aa1916bf4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.843696 426 tablet_replica.cc:333] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.844381 426 raft_consensus.cc:2243] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.845325 426 raft_consensus.cc:2272] T 810b825e4fe44036ba77841772e5192f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.847471 426 tablet_replica.cc:333] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.847940 426 raft_consensus.cc:2243] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.848623 426 raft_consensus.cc:2272] T dab5221ac7fd4760b078481dd3a91eb4 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.850076 426 tablet_replica.cc:333] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.850538 426 raft_consensus.cc:2243] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.851183 426 raft_consensus.cc:2272] T 632ff53f1d7b4cf1a811d346f5e0d6e6 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.852633 426 tablet_replica.cc:333] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.853077 426 raft_consensus.cc:2243] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.853710 426 raft_consensus.cc:2272] T 2f04d2e58d7b495fa12144051af83ae1 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.855448 426 tablet_replica.cc:333] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.856117 426 raft_consensus.cc:2243] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.856590 426 raft_consensus.cc:2272] T 7403a55fe6fa41268e8b54130c9e785d P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.858011 426 tablet_replica.cc:333] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.858438 426 raft_consensus.cc:2243] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.859043 426 raft_consensus.cc:2272] T b6292c3ac4394235a8d94502dcb65913 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.860543 426 tablet_replica.cc:333] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.860994 426 raft_consensus.cc:2243] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.861354 426 raft_consensus.cc:2272] T 9f3342ae83724ded89bf01a1e27047be P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.862732 426 tablet_replica.cc:333] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.863165 426 raft_consensus.cc:2243] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.863521 426 raft_consensus.cc:2272] T 2355bff2629046d8aedcfc2f63a52c18 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.865275 426 tablet_replica.cc:333] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.865729 426 raft_consensus.cc:2243] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.866075 426 raft_consensus.cc:2272] T ed49fbba2c19424aa9617a846079bcb3 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.867506 426 tablet_replica.cc:333] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.867955 426 raft_consensus.cc:2243] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.868649 426 raft_consensus.cc:2272] T ae04951b92bc456ab7b716b990df02db P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.870090 426 tablet_replica.cc:333] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.870573 426 raft_consensus.cc:2243] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 6 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.871212 426 raft_consensus.cc:2272] T 23db9937c6294006a7fac93aa519bad4 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.872831 426 tablet_replica.cc:333] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.873520 426 raft_consensus.cc:2243] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.874202 426 raft_consensus.cc:2272] T 46f5d70a2d6346c498b6686a9f4cb1c9 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.876117 426 tablet_replica.cc:333] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.876590 426 raft_consensus.cc:2243] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.876964 426 raft_consensus.cc:2272] T 2f9efe5a0bab4fb78f99bca3470e9bb4 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.878381 426 tablet_replica.cc:333] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.878826 426 raft_consensus.cc:2243] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.879201 426 raft_consensus.cc:2272] T 3f8f38b230664bc1a6c03587a328cca0 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.880636 426 tablet_replica.cc:333] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.881093 426 raft_consensus.cc:2243] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.881512 426 raft_consensus.cc:2272] T 894121edf7014daeaeb0e37428798ef1 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.883081 426 tablet_replica.cc:333] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.883535 426 raft_consensus.cc:2243] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.883917 426 raft_consensus.cc:2272] T c115c03783ff4ad588081a3566250c5f P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:17.884184 2258 consensus_peers.cc:597] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:17.885376 426 tablet_replica.cc:333] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.885890 426 raft_consensus.cc:2243] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.886554 426 raft_consensus.cc:2272] T 16211cc39e2742beb0d2ef6ecc0a042b P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.888463 426 tablet_replica.cc:333] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.889082 426 raft_consensus.cc:2243] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus shutting down.
W20251215 20:53:17.889545 2258 consensus_peers.cc:597] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:17.889591 426 raft_consensus.cc:2272] T 86d34bd4c9884678a883bfc6fe5393a8 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.891166 426 tablet_replica.cc:333] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.891647 426 raft_consensus.cc:2243] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.892277 426 raft_consensus.cc:2272] T f25415c071bc4a8b9f638e653062455a P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.893728 426 tablet_replica.cc:333] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.894165 426 raft_consensus.cc:2243] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.894835 426 raft_consensus.cc:2272] T 6fb924e2d4664d11b09b8aa8eccab15d P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.896340 426 tablet_replica.cc:333] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.896795 426 raft_consensus.cc:2243] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.897158 426 raft_consensus.cc:2272] T f3f658260aa8496eab50a8b6eaa515e6 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.898561 426 tablet_replica.cc:333] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.899034 426 raft_consensus.cc:2243] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.899406 426 raft_consensus.cc:2272] T 8bd979146339464bb689a3bbf6826e47 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.901108 426 tablet_replica.cc:333] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.901548 426 raft_consensus.cc:2243] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.902231 426 raft_consensus.cc:2272] T f226904c96ca4bddbd43673d79635bd7 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.903867 426 tablet_replica.cc:333] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.904354 426 raft_consensus.cc:2243] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.905014 426 raft_consensus.cc:2272] T a7d99999ba4f49a28d840d50bcdcaa16 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.906456 426 tablet_replica.cc:333] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.906935 426 raft_consensus.cc:2243] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.907817 426 raft_consensus.cc:2272] T f8b4250dab5b409685b9c36ce1898c9b P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.909379 426 tablet_replica.cc:333] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.909840 426 raft_consensus.cc:2243] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.910703 426 raft_consensus.cc:2272] T 890b2cb838964cd4974f27cd401f1a01 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.912161 426 tablet_replica.cc:333] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.912626 426 raft_consensus.cc:2243] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.913273 426 raft_consensus.cc:2272] T 9bf291090f874d4ea5be3c23a51eea18 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.914743 426 tablet_replica.cc:333] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.915189 426 raft_consensus.cc:2243] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.915846 426 raft_consensus.cc:2272] T df30f9d71a254842a4b64718482cdeb4 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.917423 426 tablet_replica.cc:333] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.917906 426 raft_consensus.cc:2243] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.918340 426 raft_consensus.cc:2272] T cd752a241baf44c3aa4fda90213e209f P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.919739 426 tablet_replica.cc:333] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.920166 426 raft_consensus.cc:2243] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.920565 426 raft_consensus.cc:2272] T 85dde241a3904afc914c383300a7cf6d P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.922101 426 tablet_replica.cc:333] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.922533 426 raft_consensus.cc:2243] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.922896 426 raft_consensus.cc:2272] T f8fcddff0659452aad4ba12a1187579f P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.924408 426 tablet_replica.cc:333] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.924996 426 raft_consensus.cc:2243] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.925459 426 raft_consensus.cc:2272] T d45abd42bd074cfeb26d8617e4c3c8b2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.927561 426 tablet_replica.cc:333] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.928169 426 raft_consensus.cc:2243] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.928673 426 raft_consensus.cc:2272] T 2bc2b2e8a3354bd186b3d721581fc8d2 P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:17.930298 2258 consensus_peers.cc:597] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:17.930790 426 tablet_replica.cc:333] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.931253 426 raft_consensus.cc:2243] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.931864 426 raft_consensus.cc:2272] T f78523b75e1f4e8a937902c8178099db P 95847161b0414d4e92d6cab94956fa57 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.933503 426 tablet_replica.cc:333] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.933933 426 raft_consensus.cc:2243] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.934353 426 raft_consensus.cc:2272] T cbf9f34352854272976701e2b99044e6 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.935988 426 tablet_replica.cc:333] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.936426 426 raft_consensus.cc:2243] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.936748 426 raft_consensus.cc:2272] T 0e8905748575496cb493cddc6f527786 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.938133 426 tablet_replica.cc:333] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.938547 426 raft_consensus.cc:2243] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 6 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.939185 426 raft_consensus.cc:2272] T f587ca4384a3442e9dfef8a059e439e8 P 95847161b0414d4e92d6cab94956fa57 [term 6 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.940732 426 tablet_replica.cc:333] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.941190 426 raft_consensus.cc:2243] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.941507 426 raft_consensus.cc:2272] T 40b5b64d429c4a079403980321090051 P 95847161b0414d4e92d6cab94956fa57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.942909 426 tablet_replica.cc:333] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.943290 426 raft_consensus.cc:2243] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.943733 426 raft_consensus.cc:2272] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P 95847161b0414d4e92d6cab94956fa57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.945400 426 tablet_replica.cc:333] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.946002 426 raft_consensus.cc:2243] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:17.946877 426 raft_consensus.cc:2272] T 15a0578355af497bb35215c17c067b09 P 95847161b0414d4e92d6cab94956fa57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:17.948940 426 tablet_replica.cc:333] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57: stopping tablet replica
I20251215 20:53:17.949327 426 raft_consensus.cc:2243] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 7 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:17.949687 426 raft_consensus.cc:2272] T 2964497f848c4ff98a3846057a1f2528 P 95847161b0414d4e92d6cab94956fa57 [term 7 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:17.993326 2258 consensus_peers.cc:597] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:18.076843 2257 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20251215 20:53:18.095870 2258 consensus_peers.cc:597] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:45401: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:18.129707 2258 consensus_peers.cc:597] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:18.183562 2258 consensus_peers.cc:597] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:18.234961 2258 consensus_peers.cc:597] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:45401: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:18.240502 2258 consensus_peers.cc:597] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:45401: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:18.274015 2258 consensus_peers.cc:597] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 -> Peer 95847161b0414d4e92d6cab94956fa57 (127.0.106.131:45401): Couldn't send request to peer 95847161b0414d4e92d6cab94956fa57. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:45401: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:18.278134 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
W20251215 20:53:18.286967 2257 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): Couldn't send request to peer 9b3367a5854f49b98da54556a209b0de. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20251215 20:53:18.320124 2258 consensus_peers.cc:597] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251215 20:53:18.353005 426 tablet_server.cc:178] TabletServer@127.0.106.132:0 shutting down...
W20251215 20:53:18.356040 2258 consensus_peers.cc:597] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 20:53:18.379410 2258 consensus_peers.cc:597] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251215 20:53:18.382529 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:53:18.383087 426 tablet_replica.cc:333] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.383608 426 raft_consensus.cc:2243] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:18.384115 426 raft_consensus.cc:2272] T 890b2cb838964cd4974f27cd401f1a01 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.386001 426 tablet_replica.cc:333] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.386498 426 raft_consensus.cc:2243] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:18.386998 426 raft_consensus.cc:2272] T 668639c78eab435fb81c2471ddacf0db P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.388723 426 tablet_replica.cc:333] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.389205 426 raft_consensus.cc:2243] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 5 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.389963 426 raft_consensus.cc:2272] T e26493deab2c43b4ba30189716986767 P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.391832 426 tablet_replica.cc:333] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.392370 426 raft_consensus.cc:2243] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:18.392810 426 raft_consensus.cc:2272] T f8b4250dab5b409685b9c36ce1898c9b P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.394352 426 tablet_replica.cc:333] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.394807 426 raft_consensus.cc:2243] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:18.395280 426 raft_consensus.cc:2272] T cd752a241baf44c3aa4fda90213e209f P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.397347 426 tablet_replica.cc:333] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.397872 426 raft_consensus.cc:2243] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 5 LEADER]: Raft consensus shutting down.
W20251215 20:53:18.398517 2258 consensus_peers.cc:597] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 -> Peer be5dd78ebc024aefa4d17b3ccf2ea1ac (127.0.106.130:37421): Couldn't send request to peer be5dd78ebc024aefa4d17b3ccf2ea1ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251215 20:53:18.398538 426 raft_consensus.cc:2272] T 46f5d70a2d6346c498b6686a9f4cb1c9 P fbfdeb011a604f78a77f04be26573717 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.400315 426 tablet_replica.cc:333] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.400804 426 raft_consensus.cc:2243] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.401554 426 raft_consensus.cc:2272] T 10e7dc78d083418c9f49bb4450d426f7 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.403192 426 tablet_replica.cc:333] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.403628 426 raft_consensus.cc:2243] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.404268 426 raft_consensus.cc:2272] T 2355bff2629046d8aedcfc2f63a52c18 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.405833 426 tablet_replica.cc:333] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.406279 426 raft_consensus.cc:2243] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:18.406736 426 raft_consensus.cc:2272] T cffb60a2970e4e049f29999509c860aa P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.408318 426 tablet_replica.cc:333] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.408747 426 raft_consensus.cc:2243] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.409356 426 raft_consensus.cc:2272] T 3f8f38b230664bc1a6c03587a328cca0 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.410913 426 tablet_replica.cc:333] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.411336 426 raft_consensus.cc:2243] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.411973 426 raft_consensus.cc:2272] T 7403a55fe6fa41268e8b54130c9e785d P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.413529 426 tablet_replica.cc:333] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.413996 426 raft_consensus.cc:2243] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.414649 426 raft_consensus.cc:2272] T ed49fbba2c19424aa9617a846079bcb3 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.416256 426 tablet_replica.cc:333] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.416733 426 raft_consensus.cc:2243] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.417357 426 raft_consensus.cc:2272] T 86d34bd4c9884678a883bfc6fe5393a8 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.418874 426 tablet_replica.cc:333] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.419348 426 raft_consensus.cc:2243] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.419934 426 raft_consensus.cc:2272] T 5f91c85f57504082af247cc60403edd1 P fbfdeb011a604f78a77f04be26573717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.421505 426 tablet_replica.cc:333] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.421916 426 raft_consensus.cc:2243] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.422545 426 raft_consensus.cc:2272] T 8350524f9e4a49929464adde48de2442 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.424082 426 tablet_replica.cc:333] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.424535 426 raft_consensus.cc:2243] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:18.424862 426 raft_consensus.cc:2272] T 0bb86f5c9ae14081b0e0633dacbfcb59 P fbfdeb011a604f78a77f04be26573717 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.426323 426 tablet_replica.cc:333] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.426723 426 raft_consensus.cc:2243] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.427335 426 raft_consensus.cc:2272] T cbf9f34352854272976701e2b99044e6 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.428884 426 tablet_replica.cc:333] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717: stopping tablet replica
I20251215 20:53:18.429270 426 raft_consensus.cc:2243] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:53:18.429883 426 raft_consensus.cc:2272] T 9b3dcc96cf314cf3a1f3d46c0b6ee0e3 P fbfdeb011a604f78a77f04be26573717 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:18.463689 426 tablet_server.cc:195] TabletServer@127.0.106.132:0 shutdown complete.
I20251215 20:53:18.490521 426 master.cc:561] Master@127.0.106.190:34859 shutting down...
W20251215 20:53:34.088217 1530 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111) [suppressed 546 similar messages]
W20251215 20:53:34.091212 1530 catalog_manager.cc:4712] TS 9b3367a5854f49b98da54556a209b0de (127.0.106.129:38541): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 46f5d70a2d6346c498b6686a9f4cb1c9: Network error: Client connection negotiation failed: client connection to 127.0.106.129:38541: connect: Connection refused (error 111)
I20251215 20:53:35.516901 426 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:35.517879 426 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:35.518257 426 tablet_replica.cc:333] T 00000000000000000000000000000000 P c49847ab665f4d658c615285f556627e: stopping tablet replica
I20251215 20:53:35.612092 426 master.cc:583] Master@127.0.106.190:34859 shutdown complete.
I20251215 20:53:35.653857 426 test_util.cc:183] -----------------------------------------------
I20251215 20:53:35.654047 426 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1765831869714107-426-0
[ FAILED ] LeaderRebalancerTest.AddTserver (83389 ms)
[ RUN ] LeaderRebalancerTest.RestartTserver
I20251215 20:53:35.657013 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:35753
I20251215 20:53:35.658162 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:53:35.663019 3611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:35.663122 3612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:35.664222 3614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:53:35.665249 426 server_base.cc:1047] running on GCE node
I20251215 20:53:35.666474 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:53:35.666648 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:53:35.666777 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832015666762 us; error 0 us; skew 500 ppm
I20251215 20:53:35.667256 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:53:35.669437 426 webserver.cc:492] Webserver started at http://127.0.106.190:43131/ using document root <none> and password file <none>
I20251215 20:53:35.669888 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:53:35.670053 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:53:35.670298 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:53:35.671445 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/master-0-root/instance:
uuid: "713c63a7487d439ba1075c4e5fd745df"
format_stamp: "Formatted at 2025-12-15 20:53:35 on dist-test-slave-xp5d"
I20251215 20:53:35.675530 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20251215 20:53:35.678556 3619 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:35.679184 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251215 20:53:35.679427 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/master-0-root
uuid: "713c63a7487d439ba1075c4e5fd745df"
format_stamp: "Formatted at 2025-12-15 20:53:35 on dist-test-slave-xp5d"
I20251215 20:53:35.679672 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:53:35.693898 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:53:35.694932 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:53:35.729863 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:35753
I20251215 20:53:35.729974 3670 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:35753 every 8 connection(s)
I20251215 20:53:35.733534 3671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:35.743480 3671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df: Bootstrap starting.
I20251215 20:53:35.747967 3671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:35.751700 3671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df: No bootstrap required, opened a new log
I20251215 20:53:35.753703 3671 raft_consensus.cc:359] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "713c63a7487d439ba1075c4e5fd745df" member_type: VOTER }
I20251215 20:53:35.754122 3671 raft_consensus.cc:385] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:35.754333 3671 raft_consensus.cc:740] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713c63a7487d439ba1075c4e5fd745df, State: Initialized, Role: FOLLOWER
I20251215 20:53:35.754853 3671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "713c63a7487d439ba1075c4e5fd745df" member_type: VOTER }
I20251215 20:53:35.755311 3671 raft_consensus.cc:399] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251215 20:53:35.755514 3671 raft_consensus.cc:493] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251215 20:53:35.755757 3671 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:35.759627 3671 raft_consensus.cc:515] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "713c63a7487d439ba1075c4e5fd745df" member_type: VOTER }
I20251215 20:53:35.760068 3671 leader_election.cc:304] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 713c63a7487d439ba1075c4e5fd745df; no voters:
I20251215 20:53:35.761116 3671 leader_election.cc:290] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [CANDIDATE]: Term 1 election: Requested vote from peers
I20251215 20:53:35.761471 3674 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:35.762702 3674 raft_consensus.cc:697] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 1 LEADER]: Becoming Leader. State: Replica: 713c63a7487d439ba1075c4e5fd745df, State: Running, Role: LEADER
I20251215 20:53:35.763378 3674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "713c63a7487d439ba1075c4e5fd745df" member_type: VOTER }
I20251215 20:53:35.763836 3671 sys_catalog.cc:565] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [sys.catalog]: configured and running, proceeding with master startup.
I20251215 20:53:35.769197 3675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "713c63a7487d439ba1075c4e5fd745df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "713c63a7487d439ba1075c4e5fd745df" member_type: VOTER } }
I20251215 20:53:35.769732 3675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [sys.catalog]: This master's current role is: LEADER
I20251215 20:53:35.769636 3676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 713c63a7487d439ba1075c4e5fd745df. Latest consensus state: current_term: 1 leader_uuid: "713c63a7487d439ba1075c4e5fd745df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "713c63a7487d439ba1075c4e5fd745df" member_type: VOTER } }
I20251215 20:53:35.770179 3676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [sys.catalog]: This master's current role is: LEADER
I20251215 20:53:35.771610 3683 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251215 20:53:35.776266 3683 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251215 20:53:35.777866 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251215 20:53:35.784253 3683 catalog_manager.cc:1357] Generated new cluster ID: 31af164608034acaaae816f946b211ae
I20251215 20:53:35.784533 3683 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251215 20:53:35.802381 3683 catalog_manager.cc:1380] Generated new certificate authority record
I20251215 20:53:35.803531 3683 catalog_manager.cc:1514] Loading token signing keys...
I20251215 20:53:35.815243 3683 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df: Generated new TSK 0
I20251215 20:53:35.815745 3683 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251215 20:53:35.843719 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:53:35.849326 3692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:35.850358 3693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:35.851622 3695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:53:35.852129 426 server_base.cc:1047] running on GCE node
I20251215 20:53:35.853330 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:53:35.853519 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:53:35.853638 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832015853628 us; error 0 us; skew 500 ppm
I20251215 20:53:35.854110 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:53:35.856091 426 webserver.cc:492] Webserver started at http://127.0.106.129:45215/ using document root <none> and password file <none>
I20251215 20:53:35.856545 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:53:35.856695 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:53:35.856904 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:53:35.857925 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root/instance:
uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
format_stamp: "Formatted at 2025-12-15 20:53:35 on dist-test-slave-xp5d"
I20251215 20:53:35.861980 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20251215 20:53:35.864916 3700 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:35.865585 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251215 20:53:35.865823 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root
uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
format_stamp: "Formatted at 2025-12-15 20:53:35 on dist-test-slave-xp5d"
I20251215 20:53:35.866053 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:53:35.896451 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:53:35.897469 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:53:35.898772 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:53:35.900874 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:53:35.901050 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:35.901266 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:53:35.901402 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:35.939287 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:40559
I20251215 20:53:35.939374 3762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:40559 every 8 connection(s)
I20251215 20:53:35.943696 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:53:35.951107 3767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:35.952436 3768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:35.953820 3770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:53:35.954661 426 server_base.cc:1047] running on GCE node
I20251215 20:53:35.955752 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:53:35.955936 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:53:35.956089 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832015956073 us; error 0 us; skew 500 ppm
I20251215 20:53:35.956598 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:53:35.959146 426 webserver.cc:492] Webserver started at http://127.0.106.130:35213/ using document root <none> and password file <none>
I20251215 20:53:35.959657 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:53:35.959846 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:53:35.960078 3763 heartbeater.cc:344] Connected to a master server at 127.0.106.190:35753
I20251215 20:53:35.960139 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:53:35.960582 3763 heartbeater.cc:461] Registering TS with master...
I20251215 20:53:35.961560 3763 heartbeater.cc:507] Master 127.0.106.190:35753 requested a full tablet report, sending...
I20251215 20:53:35.961952 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-1-root/instance:
uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
format_stamp: "Formatted at 2025-12-15 20:53:35 on dist-test-slave-xp5d"
I20251215 20:53:35.963863 3636 ts_manager.cc:194] Registered new tserver with Master: 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:35.966502 3636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57390
I20251215 20:53:35.967730 426 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20251215 20:53:35.971109 3775 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:35.971885 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251215 20:53:35.972126 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-1-root
uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
format_stamp: "Formatted at 2025-12-15 20:53:35 on dist-test-slave-xp5d"
I20251215 20:53:35.972390 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:53:35.990989 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:53:35.992064 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:53:35.993422 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:53:35.995419 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:53:35.995596 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:35.995817 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:53:35.995963 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:36.033142 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:43049
I20251215 20:53:36.033233 3837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:43049 every 8 connection(s)
I20251215 20:53:36.037564 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:53:36.045481 3842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:36.045543 3841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:53:36.048544 3838 heartbeater.cc:344] Connected to a master server at 127.0.106.190:35753
I20251215 20:53:36.048913 426 server_base.cc:1047] running on GCE node
I20251215 20:53:36.049021 3838 heartbeater.cc:461] Registering TS with master...
W20251215 20:53:36.049068 3844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:53:36.050120 3838 heartbeater.cc:507] Master 127.0.106.190:35753 requested a full tablet report, sending...
I20251215 20:53:36.050129 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:53:36.050508 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:53:36.050665 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832016050651 us; error 0 us; skew 500 ppm
I20251215 20:53:36.051359 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:53:36.052095 3636 ts_manager.cc:194] Registered new tserver with Master: 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:36.053844 426 webserver.cc:492] Webserver started at http://127.0.106.131:40635/ using document root <none> and password file <none>
I20251215 20:53:36.053915 3636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57398
I20251215 20:53:36.054602 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:53:36.054849 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:53:36.055087 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:53:36.056597 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-2-root/instance:
uuid: "36692678524d48f8b2e8cc240e9ce254"
format_stamp: "Formatted at 2025-12-15 20:53:36 on dist-test-slave-xp5d"
I20251215 20:53:36.060734 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20251215 20:53:36.063692 3849 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:36.064371 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251215 20:53:36.064620 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-2-root
uuid: "36692678524d48f8b2e8cc240e9ce254"
format_stamp: "Formatted at 2025-12-15 20:53:36 on dist-test-slave-xp5d"
I20251215 20:53:36.064915 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:53:36.094460 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:53:36.095583 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:53:36.097435 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:53:36.099911 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:53:36.100109 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:36.100416 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:53:36.100601 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:36.150678 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:45041
I20251215 20:53:36.150767 3911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:45041 every 8 connection(s)
I20251215 20:53:36.155117 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:53:36.161942 3915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:36.163300 3916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:36.164266 3918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:53:36.165781 426 server_base.cc:1047] running on GCE node
I20251215 20:53:36.166642 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251215 20:53:36.166803 3912 heartbeater.cc:344] Connected to a master server at 127.0.106.190:35753
W20251215 20:53:36.166886 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:53:36.167227 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832016167208 us; error 0 us; skew 500 ppm
I20251215 20:53:36.167312 3912 heartbeater.cc:461] Registering TS with master...
I20251215 20:53:36.167855 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:53:36.168128 3912 heartbeater.cc:507] Master 127.0.106.190:35753 requested a full tablet report, sending...
I20251215 20:53:36.170120 3636 ts_manager.cc:194] Registered new tserver with Master: 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:36.170316 426 webserver.cc:492] Webserver started at http://127.0.106.132:46409/ using document root <none> and password file <none>
I20251215 20:53:36.170799 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:53:36.170955 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:53:36.171154 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:53:36.171525 3636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57400
I20251215 20:53:36.172271 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-3-root/instance:
uuid: "b6f1369e205047049f1aa9f78c06c185"
format_stamp: "Formatted at 2025-12-15 20:53:36 on dist-test-slave-xp5d"
I20251215 20:53:36.176523 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20251215 20:53:36.179404 3923 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:36.180038 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251215 20:53:36.180272 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-3-root
uuid: "b6f1369e205047049f1aa9f78c06c185"
format_stamp: "Formatted at 2025-12-15 20:53:36 on dist-test-slave-xp5d"
I20251215 20:53:36.180527 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:53:36.199932 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:53:36.201001 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:53:36.202235 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:53:36.204526 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:53:36.204766 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:36.205000 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:53:36.205148 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:36.242084 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.132:42341
I20251215 20:53:36.242188 3985 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.132:42341 every 8 connection(s)
I20251215 20:53:36.254371 3986 heartbeater.cc:344] Connected to a master server at 127.0.106.190:35753
I20251215 20:53:36.254760 3986 heartbeater.cc:461] Registering TS with master...
I20251215 20:53:36.255439 3986 heartbeater.cc:507] Master 127.0.106.190:35753 requested a full tablet report, sending...
I20251215 20:53:36.257095 3636 ts_manager.cc:194] Registered new tserver with Master: b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:36.257249 426 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.012236427s
I20251215 20:53:36.258387 3636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57412
I20251215 20:53:36.259418 426 test_util.cc:276] Using random seed: -837818043
I20251215 20:53:36.280372 3636 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57422:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 20:53:36.508534 3951 tablet_service.cc:1505] Processing CreateTablet for tablet f2ff03e068e044b29e3c7843b2dbc453 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251215 20:53:36.510005 3951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ff03e068e044b29e3c7843b2dbc453. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.513314 3950 tablet_service.cc:1505] Processing CreateTablet for tablet 4b7e4d145d7c4085b7ad7d3578605d5c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251215 20:53:36.514621 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7e4d145d7c4085b7ad7d3578605d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.515431 3800 tablet_service.cc:1505] Processing CreateTablet for tablet c0d4826d1ea440588d15aefa34a7be66 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251215 20:53:36.516716 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d4826d1ea440588d15aefa34a7be66. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.517423 3803 tablet_service.cc:1505] Processing CreateTablet for tablet 78e2caf38d18407d85cdbfa8a8230a76 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251215 20:53:36.518128 3728 tablet_service.cc:1505] Processing CreateTablet for tablet f2ff03e068e044b29e3c7843b2dbc453 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251215 20:53:36.518699 3803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e2caf38d18407d85cdbfa8a8230a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.519402 3728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ff03e068e044b29e3c7843b2dbc453. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.521435 3802 tablet_service.cc:1505] Processing CreateTablet for tablet 4b7e4d145d7c4085b7ad7d3578605d5c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251215 20:53:36.522732 3802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7e4d145d7c4085b7ad7d3578605d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.524070 3799 tablet_service.cc:1505] Processing CreateTablet for tablet 01cbaf89fd054f4cb0385b533fae6f8c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251215 20:53:36.525357 3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cbaf89fd054f4cb0385b533fae6f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.525408 3801 tablet_service.cc:1505] Processing CreateTablet for tablet 7eb57a5ba3904de2880d27be51f34c73 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251215 20:53:36.526569 3726 tablet_service.cc:1505] Processing CreateTablet for tablet 4b7e4d145d7c4085b7ad7d3578605d5c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20251215 20:53:36.525431 3727 tablet_service.cc:1505] Processing CreateTablet for tablet 78e2caf38d18407d85cdbfa8a8230a76 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251215 20:53:36.527990 3726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7e4d145d7c4085b7ad7d3578605d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.531503 3947 tablet_service.cc:1505] Processing CreateTablet for tablet c7c37d3270014123b789c11535c96af1 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251215 20:53:36.532071 3949 tablet_service.cc:1505] Processing CreateTablet for tablet 7eb57a5ba3904de2880d27be51f34c73 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251215 20:53:36.533406 3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb57a5ba3904de2880d27be51f34c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.533782 3725 tablet_service.cc:1505] Processing CreateTablet for tablet c0d4826d1ea440588d15aefa34a7be66 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251215 20:53:36.534574 3945 tablet_service.cc:1505] Processing CreateTablet for tablet 0e812e063f2e49a49186f8a05f18c535 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251215 20:53:36.535081 3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d4826d1ea440588d15aefa34a7be66. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.534767 3798 tablet_service.cc:1505] Processing CreateTablet for tablet 57d49107996447828d7fc624dba56e4d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251215 20:53:36.533289 3946 tablet_service.cc:1505] Processing CreateTablet for tablet 57d49107996447828d7fc624dba56e4d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251215 20:53:36.536417 3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d49107996447828d7fc624dba56e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.537427 3948 tablet_service.cc:1505] Processing CreateTablet for tablet 01cbaf89fd054f4cb0385b533fae6f8c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251215 20:53:36.537891 3797 tablet_service.cc:1505] Processing CreateTablet for tablet 3f2752ef3d844a1ab4ca11c0d262f78b (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251215 20:53:36.538707 3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cbaf89fd054f4cb0385b533fae6f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.540746 3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e2caf38d18407d85cdbfa8a8230a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.540865 3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e812e063f2e49a49186f8a05f18c535. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.541831 3724 tablet_service.cc:1505] Processing CreateTablet for tablet 01cbaf89fd054f4cb0385b533fae6f8c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20251215 20:53:36.542563 3722 tablet_service.cc:1505] Processing CreateTablet for tablet 3f2752ef3d844a1ab4ca11c0d262f78b (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251215 20:53:36.543149 3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cbaf89fd054f4cb0385b533fae6f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.543834 3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2752ef3d844a1ab4ca11c0d262f78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.545115 3723 tablet_service.cc:1505] Processing CreateTablet for tablet c7c37d3270014123b789c11535c96af1 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251215 20:53:36.546365 3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c37d3270014123b789c11535c96af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.548610 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c37d3270014123b789c11535c96af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.526712 3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb57a5ba3904de2880d27be51f34c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.552616 3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2752ef3d844a1ab4ca11c0d262f78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.554415 3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d49107996447828d7fc624dba56e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.582906 3876 tablet_service.cc:1505] Processing CreateTablet for tablet 78e2caf38d18407d85cdbfa8a8230a76 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20251215 20:53:36.584605 3877 tablet_service.cc:1505] Processing CreateTablet for tablet f2ff03e068e044b29e3c7843b2dbc453 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20251215 20:53:36.585515 3875 tablet_service.cc:1505] Processing CreateTablet for tablet 7eb57a5ba3904de2880d27be51f34c73 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20251215 20:53:36.586854 3871 tablet_service.cc:1505] Processing CreateTablet for tablet 3f2752ef3d844a1ab4ca11c0d262f78b (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20251215 20:53:36.592173 3872 tablet_service.cc:1505] Processing CreateTablet for tablet 57d49107996447828d7fc624dba56e4d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20251215 20:53:36.594455 3873 tablet_service.cc:1505] Processing CreateTablet for tablet c7c37d3270014123b789c11535c96af1 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20251215 20:53:36.596482 3874 tablet_service.cc:1505] Processing CreateTablet for tablet c0d4826d1ea440588d15aefa34a7be66 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20251215 20:53:36.599263 3721 tablet_service.cc:1505] Processing CreateTablet for tablet 0e812e063f2e49a49186f8a05f18c535 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251215 20:53:36.600569 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e812e063f2e49a49186f8a05f18c535. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.604053 3796 tablet_service.cc:1505] Processing CreateTablet for tablet 0e812e063f2e49a49186f8a05f18c535 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20251215 20:53:36.605365 3796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e812e063f2e49a49186f8a05f18c535. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.605671 3876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e2caf38d18407d85cdbfa8a8230a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.620386 3877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ff03e068e044b29e3c7843b2dbc453. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.621060 3874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d4826d1ea440588d15aefa34a7be66. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.624645 3872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d49107996447828d7fc624dba56e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.632642 3875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb57a5ba3904de2880d27be51f34c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.637692 3873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c37d3270014123b789c11535c96af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.640725 3871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2752ef3d844a1ab4ca11c0d262f78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.641243 3870 tablet_service.cc:1505] Processing CreateTablet for tablet 4a40f55e64934e3384ce7a7e98833ebc (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251215 20:53:36.642575 3870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a40f55e64934e3384ce7a7e98833ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.649101 4005 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:36.656424 4006 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:36.657181 4005 tablet_bootstrap.cc:654] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:36.662155 3945 tablet_service.cc:1505] Processing CreateTablet for tablet 4a40f55e64934e3384ce7a7e98833ebc (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251215 20:53:36.663486 3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a40f55e64934e3384ce7a7e98833ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.663709 4006 tablet_bootstrap.cc:654] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:36.675601 3724 tablet_service.cc:1505] Processing CreateTablet for tablet 4a40f55e64934e3384ce7a7e98833ebc (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20251215 20:53:36.676909 3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a40f55e64934e3384ce7a7e98833ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.682298 3801 tablet_service.cc:1505] Processing CreateTablet for tablet 6888cc3ab31a4688a8fdda25f79dc586 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251215 20:53:36.683730 3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6888cc3ab31a4688a8fdda25f79dc586. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.701742 3874 tablet_service.cc:1505] Processing CreateTablet for tablet 6888cc3ab31a4688a8fdda25f79dc586 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251215 20:53:36.703256 3874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6888cc3ab31a4688a8fdda25f79dc586. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.711743 3949 tablet_service.cc:1505] Processing CreateTablet for tablet 6888cc3ab31a4688a8fdda25f79dc586 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20251215 20:53:36.713222 3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6888cc3ab31a4688a8fdda25f79dc586. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.732142 4007 tablet_bootstrap.cc:492] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:36.735301 3722 tablet_service.cc:1505] Processing CreateTablet for tablet e6511a4d6d3149b2a8cf9bd821bfbfa6 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251215 20:53:36.736780 3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6511a4d6d3149b2a8cf9bd821bfbfa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.740595 3723 tablet_service.cc:1505] Processing CreateTablet for tablet 3fa3cc7e66d147f8af03254252cfac85 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251215 20:53:36.741899 3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa3cc7e66d147f8af03254252cfac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.743788 3875 tablet_service.cc:1505] Processing CreateTablet for tablet e6511a4d6d3149b2a8cf9bd821bfbfa6 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251215 20:53:36.745113 3875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6511a4d6d3149b2a8cf9bd821bfbfa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.750231 3799 tablet_service.cc:1505] Processing CreateTablet for tablet e6511a4d6d3149b2a8cf9bd821bfbfa6 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20251215 20:53:36.751482 3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6511a4d6d3149b2a8cf9bd821bfbfa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.758630 3948 tablet_service.cc:1505] Processing CreateTablet for tablet 3fa3cc7e66d147f8af03254252cfac85 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251215 20:53:36.759845 3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa3cc7e66d147f8af03254252cfac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.763168 4005 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:36.763741 4005 ts_tablet_manager.cc:1403] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.115s user 0.004s sys 0.042s
I20251215 20:53:36.768131 3798 tablet_service.cc:1505] Processing CreateTablet for tablet 3fa3cc7e66d147f8af03254252cfac85 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20251215 20:53:36.769443 3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa3cc7e66d147f8af03254252cfac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.772310 3947 tablet_service.cc:1505] Processing CreateTablet for tablet 87b34b8adfa44d8680e7f070cad3428c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251215 20:53:36.777176 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b34b8adfa44d8680e7f070cad3428c. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:53:36.777793 3684 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:53:36.780272 3724 tablet_service.cc:1505] Processing CreateTablet for tablet 87b34b8adfa44d8680e7f070cad3428c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251215 20:53:36.781548 3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b34b8adfa44d8680e7f070cad3428c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.781899 3800 tablet_service.cc:1505] Processing CreateTablet for tablet c4219e2b494847c4b98c41a4181cbcc0 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251215 20:53:36.782301 3873 tablet_service.cc:1505] Processing CreateTablet for tablet c4219e2b494847c4b98c41a4181cbcc0 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251215 20:53:36.783406 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4219e2b494847c4b98c41a4181cbcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.783530 3873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4219e2b494847c4b98c41a4181cbcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.789737 4006 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:36.790256 4006 ts_tablet_manager.cc:1403] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.134s user 0.016s sys 0.047s
I20251215 20:53:36.794164 3950 tablet_service.cc:1505] Processing CreateTablet for tablet c4219e2b494847c4b98c41a4181cbcc0 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20251215 20:53:36.795425 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4219e2b494847c4b98c41a4181cbcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.795272 3721 tablet_service.cc:1505] Processing CreateTablet for tablet a6ccd6add84b428eb601968b0547c5a6 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251215 20:53:36.796588 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ccd6add84b428eb601968b0547c5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.801097 4010 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:36.811414 3803 tablet_service.cc:1505] Processing CreateTablet for tablet a6ccd6add84b428eb601968b0547c5a6 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251215 20:53:36.812634 3803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ccd6add84b428eb601968b0547c5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.817602 4005 raft_consensus.cc:359] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:36.817934 3871 tablet_service.cc:1505] Processing CreateTablet for tablet a6ccd6add84b428eb601968b0547c5a6 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20251215 20:53:36.819213 3871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ccd6add84b428eb601968b0547c5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.819056 3950 tablet_service.cc:1505] Processing CreateTablet for tablet 18007ad8f0ba4c649034cc34d9d4991d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251215 20:53:36.820180 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18007ad8f0ba4c649034cc34d9d4991d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.826141 3721 tablet_service.cc:1505] Processing CreateTablet for tablet 18007ad8f0ba4c649034cc34d9d4991d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251215 20:53:36.827307 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18007ad8f0ba4c649034cc34d9d4991d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.828496 3800 tablet_service.cc:1505] Processing CreateTablet for tablet 18007ad8f0ba4c649034cc34d9d4991d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20251215 20:53:36.829761 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18007ad8f0ba4c649034cc34d9d4991d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.818354 4005 raft_consensus.cc:385] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:36.830729 4005 raft_consensus.cc:740] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:36.831588 4005 consensus_queue.cc:260] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:36.832932 3870 tablet_service.cc:1505] Processing CreateTablet for tablet 87b34b8adfa44d8680e7f070cad3428c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20251215 20:53:36.834383 3870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b34b8adfa44d8680e7f070cad3428c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.835008 3875 tablet_service.cc:1505] Processing CreateTablet for tablet c5f721cb539a4588950f815d7376e735 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251215 20:53:36.836234 3949 tablet_service.cc:1505] Processing CreateTablet for tablet c5f721cb539a4588950f815d7376e735 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251215 20:53:36.837036 3724 tablet_service.cc:1505] Processing CreateTablet for tablet c5f721cb539a4588950f815d7376e735 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20251215 20:53:36.837513 3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f721cb539a4588950f815d7376e735. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.838279 3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f721cb539a4588950f815d7376e735. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.836156 3875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f721cb539a4588950f815d7376e735. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.854856 3803 tablet_service.cc:1505] Processing CreateTablet for tablet aab07a1cee7745b88f2372e58ead711e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251215 20:53:36.855608 3951 tablet_service.cc:1505] Processing CreateTablet for tablet aab07a1cee7745b88f2372e58ead711e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251215 20:53:36.856597 3728 tablet_service.cc:1505] Processing CreateTablet for tablet 7a9f02af02424808a0612e7caa798ebb (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251215 20:53:36.857821 3728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9f02af02424808a0612e7caa798ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.858733 3763 heartbeater.cc:499] Master 127.0.106.190:35753 was elected leader, sending a full tablet report...
I20251215 20:53:36.860044 4006 raft_consensus.cc:359] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:36.860929 4006 raft_consensus.cc:385] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:36.861276 4006 raft_consensus.cc:740] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:36.862120 4006 consensus_queue.cc:260] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:36.857779 4005 ts_tablet_manager.cc:1434] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.094s user 0.011s sys 0.001s
I20251215 20:53:36.865638 4005 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:36.870878 4005 tablet_bootstrap.cc:654] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:36.874382 4010 tablet_bootstrap.cc:654] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:36.876042 3986 heartbeater.cc:499] Master 127.0.106.190:35753 was elected leader, sending a full tablet report...
I20251215 20:53:36.880226 4006 ts_tablet_manager.cc:1434] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.090s user 0.009s sys 0.000s
I20251215 20:53:36.880601 4005 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:36.881115 4005 ts_tablet_manager.cc:1403] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.001s
I20251215 20:53:36.882314 3803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab07a1cee7745b88f2372e58ead711e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.884513 4005 raft_consensus.cc:359] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:36.885344 4005 raft_consensus.cc:385] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:36.885680 4005 raft_consensus.cc:740] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:36.885005 4007 tablet_bootstrap.cc:654] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:36.889765 4005 consensus_queue.cc:260] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:36.891317 3873 tablet_service.cc:1505] Processing CreateTablet for tablet aab07a1cee7745b88f2372e58ead711e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20251215 20:53:36.896673 3873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab07a1cee7745b88f2372e58ead711e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.904327 3951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab07a1cee7745b88f2372e58ead711e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.907678 4010 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:36.908181 4010 ts_tablet_manager.cc:1403] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.107s user 0.006s sys 0.016s
I20251215 20:53:36.910708 4010 raft_consensus.cc:359] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:36.911350 4010 raft_consensus.cc:385] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:36.911581 4010 raft_consensus.cc:740] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:36.912256 4010 consensus_queue.cc:260] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:36.908097 4005 ts_tablet_manager.cc:1434] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.027s user 0.005s sys 0.003s
I20251215 20:53:36.929725 3875 tablet_service.cc:1505] Processing CreateTablet for tablet 7a9f02af02424808a0612e7caa798ebb (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251215 20:53:36.931126 3875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9f02af02424808a0612e7caa798ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.915335 4005 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:36.938657 4006 tablet_bootstrap.cc:492] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:36.938825 4010 ts_tablet_manager.cc:1434] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.030s user 0.009s sys 0.009s
I20251215 20:53:36.939831 3838 heartbeater.cc:499] Master 127.0.106.190:35753 was elected leader, sending a full tablet report...
I20251215 20:53:36.940166 4010 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
W20251215 20:53:36.943928 3764 tablet.cc:2378] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 20:53:36.946779 4010 tablet_bootstrap.cc:654] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:36.950836 4005 tablet_bootstrap.cc:654] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:36.946906 4006 tablet_bootstrap.cc:654] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:36.957270 3947 tablet_service.cc:1505] Processing CreateTablet for tablet d3b16d8c675f4f6580bf11876ac11bfd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251215 20:53:36.950312 4007 tablet_bootstrap.cc:492] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:36.961583 3728 tablet_service.cc:1505] Processing CreateTablet for tablet d3b16d8c675f4f6580bf11876ac11bfd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251215 20:53:36.963727 4007 ts_tablet_manager.cc:1403] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.232s user 0.014s sys 0.019s
I20251215 20:53:36.964048 3728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b16d8c675f4f6580bf11876ac11bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.965809 3803 tablet_service.cc:1505] Processing CreateTablet for tablet d3b16d8c675f4f6580bf11876ac11bfd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20251215 20:53:36.967182 3803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b16d8c675f4f6580bf11876ac11bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.963636 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b16d8c675f4f6580bf11876ac11bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.940035 3798 tablet_service.cc:1505] Processing CreateTablet for tablet 7a9f02af02424808a0612e7caa798ebb (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20251215 20:53:36.981420 3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9f02af02424808a0612e7caa798ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.990530 3875 tablet_service.cc:1505] Processing CreateTablet for tablet d88e0d9134794daab38013d35aadbacd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251215 20:53:36.991724 3875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88e0d9134794daab38013d35aadbacd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.994208 3721 tablet_service.cc:1505] Processing CreateTablet for tablet d88e0d9134794daab38013d35aadbacd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251215 20:53:36.995615 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88e0d9134794daab38013d35aadbacd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:36.998473 3723 tablet_service.cc:1505] Processing CreateTablet for tablet 15b792f698514fcf976075ab99eda917 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251215 20:53:36.999884 3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b792f698514fcf976075ab99eda917. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.007434 4012 raft_consensus.cc:493] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.010247 3945 tablet_service.cc:1505] Processing CreateTablet for tablet fbcea7686fdf4ece84af2fb29ea12a48 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251215 20:53:37.010537 3801 tablet_service.cc:1505] Processing CreateTablet for tablet fbcea7686fdf4ece84af2fb29ea12a48 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251215 20:53:37.011152 4012 raft_consensus.cc:515] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.010386 3870 tablet_service.cc:1505] Processing CreateTablet for tablet 15b792f698514fcf976075ab99eda917 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251215 20:53:37.011584 3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcea7686fdf4ece84af2fb29ea12a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.018451 3722 tablet_service.cc:1505] Processing CreateTablet for tablet 8ff6382eccb248a4a205426da0977b1e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251215 20:53:37.019598 3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff6382eccb248a4a205426da0977b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.023564 3948 tablet_service.cc:1505] Processing CreateTablet for tablet 8ff6382eccb248a4a205426da0977b1e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251215 20:53:37.024720 3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff6382eccb248a4a205426da0977b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.020974 4016 raft_consensus.cc:493] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.027521 4016 raft_consensus.cc:515] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.029795 4016 leader_election.cc:290] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.031549 3799 tablet_service.cc:1505] Processing CreateTablet for tablet 15b792f698514fcf976075ab99eda917 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20251215 20:53:37.007748 3950 tablet_service.cc:1505] Processing CreateTablet for tablet d88e0d9134794daab38013d35aadbacd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20251215 20:53:37.032407 3874 tablet_service.cc:1505] Processing CreateTablet for tablet 1ac3237768974cdda7de26ef5b8b6740 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251215 20:53:37.033317 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88e0d9134794daab38013d35aadbacd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.034068 3800 tablet_service.cc:1505] Processing CreateTablet for tablet 8ff6382eccb248a4a205426da0977b1e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20251215 20:53:37.035065 3949 tablet_service.cc:1505] Processing CreateTablet for tablet 1ac3237768974cdda7de26ef5b8b6740 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251215 20:53:37.010537 3873 tablet_service.cc:1505] Processing CreateTablet for tablet fbcea7686fdf4ece84af2fb29ea12a48 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20251215 20:53:37.036213 3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac3237768974cdda7de26ef5b8b6740. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.038007 3870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b792f698514fcf976075ab99eda917. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.038233 4006 tablet_bootstrap.cc:492] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:37.038698 4006 ts_tablet_manager.cc:1403] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.100s user 0.021s sys 0.009s
I20251215 20:53:37.039376 3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcea7686fdf4ece84af2fb29ea12a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.039961 3874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac3237768974cdda7de26ef5b8b6740. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.040598 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff6382eccb248a4a205426da0977b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.044602 3873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcea7686fdf4ece84af2fb29ea12a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.045542 4012 leader_election.cc:290] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.058161 3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b792f698514fcf976075ab99eda917. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.030798 4007 raft_consensus.cc:359] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.061183 4007 raft_consensus.cc:385] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.061493 4007 raft_consensus.cc:740] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.062170 4007 consensus_queue.cc:260] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.062619 4005 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:37.030323 4010 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:37.093576 3721 tablet_service.cc:1505] Processing CreateTablet for tablet 1ac3237768974cdda7de26ef5b8b6740 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20251215 20:53:37.094931 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac3237768974cdda7de26ef5b8b6740. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.101518 4006 raft_consensus.cc:359] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.102353 4006 raft_consensus.cc:385] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.102653 4006 raft_consensus.cc:740] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.103381 4006 consensus_queue.cc:260] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.070526 4010 ts_tablet_manager.cc:1403] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.131s user 0.024s sys 0.004s
I20251215 20:53:37.085122 4005 ts_tablet_manager.cc:1403] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.170s user 0.027s sys 0.018s
I20251215 20:53:37.114993 4011 raft_consensus.cc:493] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.115489 4011 raft_consensus.cc:515] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.116031 3871 tablet_service.cc:1505] Processing CreateTablet for tablet 6fc6542088b34e38ae967eb065f6bd1f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251215 20:53:37.117317 3871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc6542088b34e38ae967eb065f6bd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.117905 4011 leader_election.cc:290] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.144619 4006 ts_tablet_manager.cc:1434] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.106s user 0.009s sys 0.000s
I20251215 20:53:37.145221 4010 raft_consensus.cc:359] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.146026 4010 raft_consensus.cc:385] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.146332 4010 raft_consensus.cc:740] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.147056 4010 consensus_queue.cc:260] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.149180 3947 tablet_service.cc:1505] Processing CreateTablet for tablet 6fc6542088b34e38ae967eb065f6bd1f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251215 20:53:37.150566 4006 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:37.160909 3912 heartbeater.cc:499] Master 127.0.106.190:35753 was elected leader, sending a full tablet report...
I20251215 20:53:37.166134 4006 tablet_bootstrap.cc:654] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.169117 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:37.169551 4024 raft_consensus.cc:493] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.170019 4024 raft_consensus.cc:515] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
W20251215 20:53:37.172735 3778 leader_election.cc:343] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.174080 3801 tablet_service.cc:1505] Processing CreateTablet for tablet 467dc89c982a488b8a405d00a9f39247 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251215 20:53:37.175329 3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467dc89c982a488b8a405d00a9f39247. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.178097 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:37.179491 3926 leader_election.cc:343] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.187779 4007 ts_tablet_manager.cc:1434] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.224s user 0.009s sys 0.013s
I20251215 20:53:37.188850 4007 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:37.186659 4010 ts_tablet_manager.cc:1434] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.082s user 0.004s sys 0.003s
I20251215 20:53:37.191959 4010 tablet_bootstrap.cc:492] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:37.196372 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc6542088b34e38ae967eb065f6bd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.198166 3800 tablet_service.cc:1505] Processing CreateTablet for tablet 6fc6542088b34e38ae967eb065f6bd1f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20251215 20:53:37.199551 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc6542088b34e38ae967eb065f6bd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.204236 4005 raft_consensus.cc:359] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.208190 4005 raft_consensus.cc:385] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.215215 4005 raft_consensus.cc:740] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.205204 4024 leader_election.cc:290] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:37.216008 3945 tablet_service.cc:1505] Processing CreateTablet for tablet 2d68c2b110ed41cb96b24e3f1034082a (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251215 20:53:37.217242 3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d68c2b110ed41cb96b24e3f1034082a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.217005 3874 tablet_service.cc:1505] Processing CreateTablet for tablet 467dc89c982a488b8a405d00a9f39247 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251215 20:53:37.218957 3874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467dc89c982a488b8a405d00a9f39247. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.216015 4005 consensus_queue.cc:260] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.231582 4005 ts_tablet_manager.cc:1434] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.120s user 0.001s sys 0.006s
I20251215 20:53:37.232579 4005 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:37.234468 3949 tablet_service.cc:1505] Processing CreateTablet for tablet 6f8125d05ac2440d8825d3fffa8fc079 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251215 20:53:37.235796 3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8125d05ac2440d8825d3fffa8fc079. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.239338 3870 tablet_service.cc:1505] Processing CreateTablet for tablet f6371592021d429ba136b0ef52728bbb (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251215 20:53:37.240157 4010 tablet_bootstrap.cc:654] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.240603 3870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6371592021d429ba136b0ef52728bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.248432 4005 tablet_bootstrap.cc:654] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.256012 4011 raft_consensus.cc:493] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.257401 4011 raft_consensus.cc:515] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.259507 4011 leader_election.cc:290] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.239352 3873 tablet_service.cc:1505] Processing CreateTablet for tablet 6f8125d05ac2440d8825d3fffa8fc079 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251215 20:53:37.269692 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:37.270370 3738 raft_consensus.cc:2468] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:37.272678 3721 tablet_service.cc:1505] Processing CreateTablet for tablet 467dc89c982a488b8a405d00a9f39247 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20251215 20:53:37.274464 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467dc89c982a488b8a405d00a9f39247. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.275002 3722 tablet_service.cc:1505] Processing CreateTablet for tablet 2d68c2b110ed41cb96b24e3f1034082a (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20251215 20:53:37.277667 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:37.278308 3800 tablet_service.cc:1505] Processing CreateTablet for tablet 2d68c2b110ed41cb96b24e3f1034082a (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20251215 20:53:37.279136 3703 leader_election.cc:343] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.280047 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d68c2b110ed41cb96b24e3f1034082a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.278756 3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d68c2b110ed41cb96b24e3f1034082a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.281834 4006 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:37.283725 4006 ts_tablet_manager.cc:1403] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.133s user 0.013s sys 0.002s
I20251215 20:53:37.284017 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:37.285894 3703 leader_election.cc:343] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.293262 3875 tablet_service.cc:1505] Processing CreateTablet for tablet 820e3cc7d81046f1b3436c369048939e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251215 20:53:37.294006 4006 raft_consensus.cc:359] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:37.301025 4006 raft_consensus.cc:385] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.301784 4006 raft_consensus.cc:740] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.304067 3873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8125d05ac2440d8825d3fffa8fc079. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.304952 3947 tablet_service.cc:1505] Processing CreateTablet for tablet f6371592021d429ba136b0ef52728bbb (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251215 20:53:37.306197 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6371592021d429ba136b0ef52728bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.306067 3950 tablet_service.cc:1505] Processing CreateTablet for tablet a83049337c094dcb8a7150a796d41592 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251215 20:53:37.307389 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83049337c094dcb8a7150a796d41592. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.310808 4007 tablet_bootstrap.cc:654] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.311476 4006 consensus_queue.cc:260] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:37.318446 4012 raft_consensus.cc:493] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.318886 4012 raft_consensus.cc:515] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.320986 4012 leader_election.cc:290] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.325795 4006 ts_tablet_manager.cc:1434] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.042s user 0.006s sys 0.001s
I20251215 20:53:37.330322 3800 tablet_service.cc:1505] Processing CreateTablet for tablet f6371592021d429ba136b0ef52728bbb (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20251215 20:53:37.333400 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6371592021d429ba136b0ef52728bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.340214 3777 leader_election.cc:304] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.342201 3723 tablet_service.cc:1505] Processing CreateTablet for tablet 6f8125d05ac2440d8825d3fffa8fc079 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20251215 20:53:37.342540 3870 tablet_service.cc:1505] Processing CreateTablet for tablet 92aa097b972542fe997003b6178e7e41 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251215 20:53:37.343521 3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8125d05ac2440d8825d3fffa8fc079. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.356734 3877 tablet_service.cc:1505] Processing CreateTablet for tablet 6a21e159520040a682326bc0b83248ff (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251215 20:53:37.357146 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "57d49107996447828d7fc624dba56e4d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:37.357874 3887 raft_consensus.cc:2468] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:37.358132 3875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820e3cc7d81046f1b3436c369048939e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.359287 3877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a21e159520040a682326bc0b83248ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.359103 3926 leader_election.cc:304] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:37.362059 4012 raft_consensus.cc:2804] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:37.357121 4010 tablet_bootstrap.cc:492] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:37.362414 4012 raft_consensus.cc:493] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:37.362735 4010 ts_tablet_manager.cc:1403] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.171s user 0.005s sys 0.013s
I20251215 20:53:37.362777 4012 raft_consensus.cc:3060] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.365322 3870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aa097b972542fe997003b6178e7e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.365720 4010 raft_consensus.cc:359] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.366395 4010 raft_consensus.cc:385] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.366685 4010 raft_consensus.cc:740] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.367987 4016 raft_consensus.cc:493] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.369153 4016 raft_consensus.cc:515] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.371019 4016 leader_election.cc:290] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.371482 4016 raft_consensus.cc:2804] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:37.371807 4016 raft_consensus.cc:493] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:37.372002 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:37.373319 3778 leader_election.cc:343] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.374593 4016 raft_consensus.cc:3060] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.375891 3945 tablet_service.cc:1505] Processing CreateTablet for tablet 92aa097b972542fe997003b6178e7e41 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251215 20:53:37.377171 3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aa097b972542fe997003b6178e7e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.367340 4010 consensus_queue.cc:260] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.392028 3950 tablet_service.cc:1505] Processing CreateTablet for tablet 6a21e159520040a682326bc0b83248ff (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251215 20:53:37.392472 4016 raft_consensus.cc:515] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.393368 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a21e159520040a682326bc0b83248ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.394392 4016 leader_election.cc:290] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.395567 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:37.397117 3778 leader_election.cc:343] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.398533 4012 raft_consensus.cc:515] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.399982 4005 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:37.400534 4005 ts_tablet_manager.cc:1403] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.168s user 0.012s sys 0.011s
I20251215 20:53:37.403352 4005 raft_consensus.cc:359] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.405582 4010 ts_tablet_manager.cc:1434] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.042s user 0.004s sys 0.002s
I20251215 20:53:37.411219 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "57d49107996447828d7fc624dba56e4d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:37.411861 3887 raft_consensus.cc:3060] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.415400 4010 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:37.419977 4006 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:37.420356 4012 leader_election.cc:290] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.421823 3887 raft_consensus.cc:2468] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:37.422894 3926 leader_election.cc:304] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:37.428222 4007 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:37.428797 4007 ts_tablet_manager.cc:1403] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.240s user 0.032s sys 0.021s
I20251215 20:53:37.424809 4012 raft_consensus.cc:2804] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:37.427822 3874 tablet_service.cc:1505] Processing CreateTablet for tablet bccb018083644a71b59e3afc68611be2 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251215 20:53:37.407783 4005 raft_consensus.cc:385] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.436628 3949 tablet_service.cc:1505] Processing CreateTablet for tablet be5be8f0ad8e4eaba735e5da252f993e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251215 20:53:37.437825 3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5be8f0ad8e4eaba735e5da252f993e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.435055 4005 raft_consensus.cc:740] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.440361 4005 consensus_queue.cc:260] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.442371 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:37.443006 3738 raft_consensus.cc:2468] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:37.443343 3723 tablet_service.cc:1505] Processing CreateTablet for tablet 820e3cc7d81046f1b3436c369048939e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251215 20:53:37.443614 3721 tablet_service.cc:1505] Processing CreateTablet for tablet a83049337c094dcb8a7150a796d41592 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251215 20:53:37.444567 3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820e3cc7d81046f1b3436c369048939e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.445183 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83049337c094dcb8a7150a796d41592. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.446887 4007 raft_consensus.cc:359] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.450327 4011 raft_consensus.cc:493] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.450441 4006 tablet_bootstrap.cc:654] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.450778 4011 raft_consensus.cc:515] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.452632 4011 leader_election.cc:290] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:37.453866 3722 tablet_service.cc:1505] Processing CreateTablet for tablet 92aa097b972542fe997003b6178e7e41 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20251215 20:53:37.455097 3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aa097b972542fe997003b6178e7e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.456758 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b7e4d145d7c4085b7ad7d3578605d5c" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:37.457214 3728 tablet_service.cc:1505] Processing CreateTablet for tablet bccb018083644a71b59e3afc68611be2 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251215 20:53:37.457942 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:37.458400 3728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccb018083644a71b59e3afc68611be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.458261 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:37.458998 3813 raft_consensus.cc:2393] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 230b971d5efa4b3aa8d8f05fc3a3faec in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:37.459605 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b7e4d145d7c4085b7ad7d3578605d5c" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:37.460892 3874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccb018083644a71b59e3afc68611be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.461838 3925 leader_election.cc:304] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.463497 3948 tablet_service.cc:1505] Processing CreateTablet for tablet d9f1dde6ceb14bfd881708502fbbc307 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251215 20:53:37.464696 3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f1dde6ceb14bfd881708502fbbc307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.470754 3951 tablet_service.cc:1505] Processing CreateTablet for tablet 2b7ca5082d6447b0abc43526a605e3fe (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251215 20:53:37.471951 3951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7ca5082d6447b0abc43526a605e3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.474015 3871 tablet_service.cc:1505] Processing CreateTablet for tablet 8c98269ae53148f29fa1722a088a3c71 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251215 20:53:37.475160 3871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c98269ae53148f29fa1722a088a3c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.476437 4005 ts_tablet_manager.cc:1434] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.076s user 0.007s sys 0.000s
I20251215 20:53:37.477375 4005 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:37.458963 3961 raft_consensus.cc:2468] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:37.486143 3872 tablet_service.cc:1505] Processing CreateTablet for tablet 9214cecd3f6d4af381064ccde6023020 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251215 20:53:37.487318 3872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9214cecd3f6d4af381064ccde6023020. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.489890 3946 tablet_service.cc:1505] Processing CreateTablet for tablet 9214cecd3f6d4af381064ccde6023020 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251215 20:53:37.491046 3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9214cecd3f6d4af381064ccde6023020. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.493198 3875 tablet_service.cc:1505] Processing CreateTablet for tablet 2b7ca5082d6447b0abc43526a605e3fe (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251215 20:53:37.494433 3875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7ca5082d6447b0abc43526a605e3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.495618 3876 tablet_service.cc:1505] Processing CreateTablet for tablet aef546d01dde465191d2485943bf84b1 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251215 20:53:37.496863 3876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef546d01dde465191d2485943bf84b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.497134 3873 tablet_service.cc:1505] Processing CreateTablet for tablet d9f1dde6ceb14bfd881708502fbbc307 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251215 20:53:37.499660 3873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f1dde6ceb14bfd881708502fbbc307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.501369 4010 tablet_bootstrap.cc:654] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:37.506718 3704 leader_election.cc:343] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.507486 3704 leader_election.cc:304] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.520989 4005 tablet_bootstrap.cc:654] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.481616 4007 raft_consensus.cc:385] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.521422 4011 raft_consensus.cc:2804] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
W20251215 20:53:37.435321 3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 95323.1us
I20251215 20:53:37.528879 4011 raft_consensus.cc:493] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:37.529327 4011 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.530683 3724 tablet_service.cc:1505] Processing CreateTablet for tablet be5be8f0ad8e4eaba735e5da252f993e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251215 20:53:37.531906 3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5be8f0ad8e4eaba735e5da252f993e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.520081 4012 raft_consensus.cc:697] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:37.524127 4007 raft_consensus.cc:740] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.538793 3800 tablet_service.cc:1505] Processing CreateTablet for tablet 820e3cc7d81046f1b3436c369048939e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20251215 20:53:37.569837 3796 tablet_service.cc:1505] Processing CreateTablet for tablet 2b7ca5082d6447b0abc43526a605e3fe (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20251215 20:53:37.570176 3802 tablet_service.cc:1505] Processing CreateTablet for tablet 8c98269ae53148f29fa1722a088a3c71 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251215 20:53:37.570849 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820e3cc7d81046f1b3436c369048939e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.571491 3802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c98269ae53148f29fa1722a088a3c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.553895 4010 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:37.555531 3726 tablet_service.cc:1505] Processing CreateTablet for tablet 8c98269ae53148f29fa1722a088a3c71 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20251215 20:53:37.538815 3727 tablet_service.cc:1505] Processing CreateTablet for tablet d9f1dde6ceb14bfd881708502fbbc307 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20251215 20:53:37.573791 3726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c98269ae53148f29fa1722a088a3c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.576944 4010 ts_tablet_manager.cc:1403] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.162s user 0.011s sys 0.001s
I20251215 20:53:37.577571 3719 tablet_service.cc:1505] Processing CreateTablet for tablet b0459c455a09425d8a6db8c7b275dabd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251215 20:53:37.578811 3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0459c455a09425d8a6db8c7b275dabd. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:53:37.580650 3704 leader_election.cc:343] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.584455 3704 leader_election.cc:304] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:37.556398 4011 raft_consensus.cc:515] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.557291 3799 tablet_service.cc:1505] Processing CreateTablet for tablet 6a21e159520040a682326bc0b83248ff (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20251215 20:53:37.589818 4006 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:37.559049 3725 tablet_service.cc:1505] Processing CreateTablet for tablet cd353b21737a444a83aad51cf35b0050 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20251215 20:53:37.588177 3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 126528us
I20251215 20:53:37.591382 4011 leader_election.cc:290] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.591918 4011 raft_consensus.cc:2749] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:37.558859 4012 consensus_queue.cc:237] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.560858 3798 tablet_service.cc:1505] Processing CreateTablet for tablet bccb018083644a71b59e3afc68611be2 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20251215 20:53:37.563256 3720 tablet_service.cc:1505] Processing CreateTablet for tablet 9214cecd3f6d4af381064ccde6023020 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20251215 20:53:37.564586 3872 tablet_service.cc:1505] Processing CreateTablet for tablet b0459c455a09425d8a6db8c7b275dabd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251215 20:53:37.565197 3803 tablet_service.cc:1505] Processing CreateTablet for tablet be5be8f0ad8e4eaba735e5da252f993e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20251215 20:53:37.620126 3872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0459c455a09425d8a6db8c7b275dabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.568377 3947 tablet_service.cc:1505] Processing CreateTablet for tablet cd353b21737a444a83aad51cf35b0050 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251215 20:53:37.550014 3801 tablet_service.cc:1505] Processing CreateTablet for tablet a83049337c094dcb8a7150a796d41592 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20251215 20:53:37.588451 3796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7ca5082d6447b0abc43526a605e3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.589041 4043 raft_consensus.cc:2804] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:37.589529 4041 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.588922 3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f1dde6ceb14bfd881708502fbbc307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.590344 4006 ts_tablet_manager.cc:1403] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.203s user 0.012s sys 0.013s
I20251215 20:53:37.637573 3870 tablet_service.cc:1505] Processing CreateTablet for tablet f4e98056a2e24e4a9381fc3ee9451a8e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251215 20:53:37.637827 4041 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:37.638806 3870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e98056a2e24e4a9381fc3ee9451a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.639384 4006 raft_consensus.cc:359] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.639931 4041 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:37.640092 4006 raft_consensus.cc:385] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.597060 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "57d49107996447828d7fc624dba56e4d" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:37.640512 4043 raft_consensus.cc:493] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:37.606642 3797 tablet_service.cc:1505] Processing CreateTablet for tablet cd353b21737a444a83aad51cf35b0050 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20251215 20:53:37.580003 4010 raft_consensus.cc:359] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.600867 4007 consensus_queue.cc:260] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.642292 3720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9214cecd3f6d4af381064ccde6023020. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.644200 4007 ts_tablet_manager.cc:1434] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.212s user 0.007s sys 0.005s
I20251215 20:53:37.632689 3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83049337c094dcb8a7150a796d41592. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.640933 4043 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.645169 4007 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:37.646932 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd353b21737a444a83aad51cf35b0050. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.615870 3946 tablet_service.cc:1505] Processing CreateTablet for tablet 1a03f70d92df4d41bdf5049341172bc4 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251215 20:53:37.622088 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:37.648557 3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccb018083644a71b59e3afc68611be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.648993 3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a03f70d92df4d41bdf5049341172bc4. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:53:37.649464 3703 leader_election.cc:343] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.614447 3950 tablet_service.cc:1505] Processing CreateTablet for tablet aef546d01dde465191d2485943bf84b1 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251215 20:53:37.628275 3795 tablet_service.cc:1505] Processing CreateTablet for tablet aef546d01dde465191d2485943bf84b1 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20251215 20:53:37.652082 3800 tablet_service.cc:1505] Processing CreateTablet for tablet b0459c455a09425d8a6db8c7b275dabd (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20251215 20:53:37.653859 3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0459c455a09425d8a6db8c7b275dabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.655243 3794 tablet_service.cc:1505] Processing CreateTablet for tablet 1a03f70d92df4d41bdf5049341172bc4 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251215 20:53:37.642338 4010 raft_consensus.cc:385] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.640434 4006 raft_consensus.cc:740] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.662390 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef546d01dde465191d2485943bf84b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.666826 3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd353b21737a444a83aad51cf35b0050. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.671953 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:37.673339 3951 tablet_service.cc:1505] Processing CreateTablet for tablet f4e98056a2e24e4a9381fc3ee9451a8e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251215 20:53:37.674542 3951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e98056a2e24e4a9381fc3ee9451a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.676410 3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd353b21737a444a83aad51cf35b0050. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.667953 4010 raft_consensus.cc:740] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.678615 3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef546d01dde465191d2485943bf84b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.679071 4010 consensus_queue.cc:260] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.679744 4005 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:37.680222 4005 ts_tablet_manager.cc:1403] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.203s user 0.008s sys 0.005s
I20251215 20:53:37.683588 4005 raft_consensus.cc:359] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.684257 4005 raft_consensus.cc:385] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.684551 4005 raft_consensus.cc:740] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.685204 4005 consensus_queue.cc:260] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.688897 3794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a03f70d92df4d41bdf5049341172bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.691689 4005 ts_tablet_manager.cc:1434] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20251215 20:53:37.692282 3803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5be8f0ad8e4eaba735e5da252f993e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.692709 4005 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:37.693827 4010 ts_tablet_manager.cc:1434] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.117s user 0.008s sys 0.000s
I20251215 20:53:37.694808 4010 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:37.696573 3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a21e159520040a682326bc0b83248ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.704501 4006 consensus_queue.cc:260] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.706097 4041 raft_consensus.cc:493] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.706717 4005 tablet_bootstrap.cc:654] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.706511 4041 raft_consensus.cc:515] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.707003 4006 ts_tablet_manager.cc:1434] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.070s user 0.005s sys 0.001s
I20251215 20:53:37.707962 4006 tablet_bootstrap.cc:492] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:37.708756 4041 leader_election.cc:290] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:37.710558 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7c37d3270014123b789c11535c96af1" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:37.711915 3926 leader_election.cc:343] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:37.677655 3704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:43049, user_credentials={real_user=slave}} blocked reactor thread for 97038.5us
I20251215 20:53:37.729368 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:37.729969 3738 raft_consensus.cc:3060] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.730577 3875 tablet_service.cc:1505] Processing CreateTablet for tablet 652957cad9bb4393811a50c064710b1f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251215 20:53:37.731835 3875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652957cad9bb4393811a50c064710b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.739027 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "57d49107996447828d7fc624dba56e4d" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:37.738531 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:37.737438 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "57d49107996447828d7fc624dba56e4d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:37.737807 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "57d49107996447828d7fc624dba56e4d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:37.745807 3634 catalog_manager.cc:5654] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:37.740324 3945 tablet_service.cc:1505] Processing CreateTablet for tablet 652957cad9bb4393811a50c064710b1f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20251215 20:53:37.747109 3738 raft_consensus.cc:2468] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:37.747702 3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652957cad9bb4393811a50c064710b1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:53:37.737993 3777 leader_election.cc:343] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.752833 3777 leader_election.cc:304] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.753691 4040 raft_consensus.cc:2749] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:53:37.754398 3853 leader_election.cc:343] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.754853 3853 leader_election.cc:304] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:37.755401 3777 leader_election.cc:304] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.755894 4024 raft_consensus.cc:2749] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:37.756143 4040 raft_consensus.cc:2804] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:37.756661 4040 raft_consensus.cc:697] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
W20251215 20:53:37.756803 3927 leader_election.cc:343] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.757372 4040 consensus_queue.cc:237] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:37.757490 3927 leader_election.cc:343] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.757434 3795 tablet_service.cc:1505] Processing CreateTablet for tablet 652957cad9bb4393811a50c064710b1f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20251215 20:53:37.758469 3927 leader_election.cc:343] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.758744 3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652957cad9bb4393811a50c064710b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.764798 4005 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:37.765293 4005 ts_tablet_manager.cc:1403] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.013s
I20251215 20:53:37.768177 4005 raft_consensus.cc:359] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:37.768882 4005 raft_consensus.cc:385] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.769184 4005 raft_consensus.cc:740] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.769855 4005 consensus_queue.cc:260] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:37.763223 4043 raft_consensus.cc:515] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.773027 4005 ts_tablet_manager.cc:1434] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20251215 20:53:37.775509 4005 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:37.775825 4007 tablet_bootstrap.cc:654] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.777225 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:37.778518 3926 leader_election.cc:343] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:37.780186 3684 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:53:37.776139 4043 leader_election.cc:290] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.787968 4010 tablet_bootstrap.cc:654] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.735056 3704 leader_election.cc:304] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.788949 4046 raft_consensus.cc:2749] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:37.789208 4005 tablet_bootstrap.cc:654] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:37.789743 3704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:43049, user_credentials={real_user=slave}} blocked reactor thread for 57086.7us
I20251215 20:53:37.790997 4024 raft_consensus.cc:493] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.791273 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:37.791471 4024 raft_consensus.cc:515] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.792058 3961 raft_consensus.cc:2393] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 230b971d5efa4b3aa8d8f05fc3a3faec in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:37.792181 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:37.793623 4024 leader_election.cc:290] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:37.793641 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7c37d3270014123b789c11535c96af1" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:37.795954 3738 raft_consensus.cc:2468] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:37.796119 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:37.798408 3737 raft_consensus.cc:2393] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:37.799226 3795 tablet_service.cc:1505] Processing CreateTablet for tablet 0807745e47db47f7baefd68c4488a72d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251215 20:53:37.800427 3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0807745e47db47f7baefd68c4488a72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.797286 3719 tablet_service.cc:1505] Processing CreateTablet for tablet 1a03f70d92df4d41bdf5049341172bc4 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20251215 20:53:37.802392 3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a03f70d92df4d41bdf5049341172bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.797518 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:37.813019 3727 tablet_service.cc:1505] Processing CreateTablet for tablet f4e98056a2e24e4a9381fc3ee9451a8e (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20251215 20:53:37.814252 3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e98056a2e24e4a9381fc3ee9451a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.815686 3874 tablet_service.cc:1505] Processing CreateTablet for tablet 0807745e47db47f7baefd68c4488a72d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251215 20:53:37.816871 3874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0807745e47db47f7baefd68c4488a72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.823077 4006 tablet_bootstrap.cc:654] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:37.844009 3633 catalog_manager.cc:5654] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:37.852993 3925 leader_election.cc:343] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.857229 3721 tablet_service.cc:1505] Processing CreateTablet for tablet 0807745e47db47f7baefd68c4488a72d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20251215 20:53:37.857652 3925 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:37.858873 3925 leader_election.cc:304] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.860484 4012 raft_consensus.cc:2749] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:37.861138 4012 raft_consensus.cc:2804] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:37.861490 4012 raft_consensus.cc:493] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:37.861804 4012 raft_consensus.cc:3060] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.862574 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0807745e47db47f7baefd68c4488a72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.867348 3802 tablet_service.cc:1505] Processing CreateTablet for tablet 72a5c0bc6cfd443bb366d645e217dbe7 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251215 20:53:37.868577 3802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a5c0bc6cfd443bb366d645e217dbe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.859999 3925 leader_election.cc:304] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.871155 4043 raft_consensus.cc:2749] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:37.871611 3947 tablet_service.cc:1505] Processing CreateTablet for tablet 72a5c0bc6cfd443bb366d645e217dbe7 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251215 20:53:37.872805 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a5c0bc6cfd443bb366d645e217dbe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.875604 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:37.876888 3737 raft_consensus.cc:2393] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:37.878151 3851 leader_election.cc:304] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:37.878438 3873 tablet_service.cc:1505] Processing CreateTablet for tablet 5d37236082954925b36d02b68cbd3a0f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251215 20:53:37.879266 4024 raft_consensus.cc:3060] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.879603 3873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d37236082954925b36d02b68cbd3a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.882469 3950 tablet_service.cc:1505] Processing CreateTablet for tablet 5d37236082954925b36d02b68cbd3a0f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251215 20:53:37.882937 4007 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:37.883495 4005 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:37.883672 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d37236082954925b36d02b68cbd3a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.883952 4005 ts_tablet_manager.cc:1403] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.109s user 0.027s sys 0.001s
I20251215 20:53:37.884172 3704 leader_election.cc:304] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:37.883417 4007 ts_tablet_manager.cc:1403] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.238s user 0.010s sys 0.020s
I20251215 20:53:37.888098 4007 raft_consensus.cc:359] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.888782 4007 raft_consensus.cc:385] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.889052 4007 raft_consensus.cc:740] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.889964 4046 raft_consensus.cc:2749] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:37.891848 4024 raft_consensus.cc:2749] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:37.894663 4007 consensus_queue.cc:260] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.893137 3801 tablet_service.cc:1505] Processing CreateTablet for tablet 50e3aad815f9468187ec1d605addfcb4 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251215 20:53:37.893765 3725 tablet_service.cc:1505] Processing CreateTablet for tablet 72a5c0bc6cfd443bb366d645e217dbe7 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20251215 20:53:37.896174 3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a5c0bc6cfd443bb366d645e217dbe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.875559 4012 raft_consensus.cc:515] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.894555 3719 tablet_service.cc:1505] Processing CreateTablet for tablet 5d37236082954925b36d02b68cbd3a0f (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20251215 20:53:37.900552 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7c37d3270014123b789c11535c96af1" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:37.900972 3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d37236082954925b36d02b68cbd3a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.900699 3874 tablet_service.cc:1505] Processing CreateTablet for tablet 50e3aad815f9468187ec1d605addfcb4 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251215 20:53:37.901691 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7c37d3270014123b789c11535c96af1" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:37.902271 3737 raft_consensus.cc:3060] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:37.904035 3926 leader_election.cc:343] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.904599 4046 raft_consensus.cc:493] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.905041 4046 raft_consensus.cc:515] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.905874 4012 leader_election.cc:290] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:37.906890 4046 leader_election.cc:290] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.908360 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:37.908951 3887 raft_consensus.cc:2468] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:37.910161 3703 leader_election.cc:304] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:37.911938 4046 raft_consensus.cc:2804] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:37.912317 4046 raft_consensus.cc:493] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:37.913120 4046 raft_consensus.cc:3060] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.916663 4005 raft_consensus.cc:359] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:37.917492 4011 raft_consensus.cc:493] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:37.917953 4011 raft_consensus.cc:515] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:37.919088 3945 tablet_service.cc:1505] Processing CreateTablet for tablet 50e3aad815f9468187ec1d605addfcb4 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20251215 20:53:37.919731 4011 leader_election.cc:290] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:37.920356 3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e3aad815f9468187ec1d605addfcb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.917351 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:37.901947 3874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e3aad815f9468187ec1d605addfcb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.896185 3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e3aad815f9468187ec1d605addfcb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.917354 4005 raft_consensus.cc:385] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.919611 3737 raft_consensus.cc:2468] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:37.940039 3797 tablet_service.cc:1505] Processing CreateTablet for tablet 723425b3ad41419c9207bc5880db1c1c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251215 20:53:37.946861 4007 ts_tablet_manager.cc:1434] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.061s user 0.005s sys 0.012s
I20251215 20:53:37.945852 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01cbaf89fd054f4cb0385b533fae6f8c" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:37.947117 3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723425b3ad41419c9207bc5880db1c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.955245 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01cbaf89fd054f4cb0385b533fae6f8c" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:37.955449 3872 tablet_service.cc:1505] Processing CreateTablet for tablet 723425b3ad41419c9207bc5880db1c1c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251215 20:53:37.956938 3872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723425b3ad41419c9207bc5880db1c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.955420 4046 raft_consensus.cc:515] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:37.962077 3704 leader_election.cc:343] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.962144 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:37.962790 3887 raft_consensus.cc:3060] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:37.964242 3727 tablet_service.cc:1505] Processing CreateTablet for tablet 723425b3ad41419c9207bc5880db1c1c (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20251215 20:53:37.966053 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:37.966936 3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723425b3ad41419c9207bc5880db1c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.964730 3925 leader_election.cc:304] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:37.969434 4012 raft_consensus.cc:2804] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:37.969890 4012 raft_consensus.cc:697] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:37.971230 4046 leader_election.cc:290] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:37.970587 3887 raft_consensus.cc:2468] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:37.972729 3703 leader_election.cc:304] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:37.973734 4046 raft_consensus.cc:2804] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:37.972994 4007 tablet_bootstrap.cc:492] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
W20251215 20:53:37.965703 3704 leader_election.cc:343] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.975061 4046 raft_consensus.cc:697] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:37.936795 4005 raft_consensus.cc:740] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:37.970675 4012 consensus_queue.cc:237] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:37.985719 4006 tablet_bootstrap.cc:492] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
W20251215 20:53:37.982980 3704 leader_election.cc:343] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.985242 3950 tablet_service.cc:1505] Processing CreateTablet for tablet f1ac152899e2447cb009e0cdcfa8c729 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251215 20:53:37.993422 4006 ts_tablet_manager.cc:1403] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.286s user 0.013s sys 0.007s
I20251215 20:53:37.994207 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ac152899e2447cb009e0cdcfa8c729. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:37.993085 3704 leader_election.cc:304] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:37.996973 4011 raft_consensus.cc:2749] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:53:37.998031 3704 leader_election.cc:343] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:37.996184 4006 raft_consensus.cc:359] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:37.999647 4006 raft_consensus.cc:385] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:37.999924 4006 raft_consensus.cc:740] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.002529 4006 consensus_queue.cc:260] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.005090 4010 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.005587 4010 ts_tablet_manager.cc:1403] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.311s user 0.030s sys 0.011s
I20251215 20:53:38.007308 4040 raft_consensus.cc:493] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.007761 4040 raft_consensus.cc:515] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.009923 4040 leader_election.cc:290] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.012377 4007 tablet_bootstrap.cc:654] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.019958 4005 consensus_queue.cc:260] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.021948 4010 raft_consensus.cc:359] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.022795 4010 raft_consensus.cc:385] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.023099 4010 raft_consensus.cc:740] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.024124 3870 tablet_service.cc:1505] Processing CreateTablet for tablet b302275303b54dc3a70558581fd3ae49 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251215 20:53:38.025472 3870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302275303b54dc3a70558581fd3ae49. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.022992 4005 ts_tablet_manager.cc:1434] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.139s user 0.007s sys 0.000s
I20251215 20:53:37.976747 4046 consensus_queue.cc:237] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.029318 4005 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.029923 3795 tablet_service.cc:1505] Processing CreateTablet for tablet f1ac152899e2447cb009e0cdcfa8c729 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251215 20:53:38.030611 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.031268 3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ac152899e2447cb009e0cdcfa8c729. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.023761 4010 consensus_queue.cc:260] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.041795 3721 tablet_service.cc:1505] Processing CreateTablet for tablet b302275303b54dc3a70558581fd3ae49 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251215 20:53:38.042954 3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302275303b54dc3a70558581fd3ae49. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.044863 4006 ts_tablet_manager.cc:1434] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.051s user 0.007s sys 0.000s
I20251215 20:53:38.045097 3725 tablet_service.cc:1505] Processing CreateTablet for tablet f1ac152899e2447cb009e0cdcfa8c729 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20251215 20:53:38.050138 3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ac152899e2447cb009e0cdcfa8c729. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.051544 3802 tablet_service.cc:1505] Processing CreateTablet for tablet b5e9420df6384a1f9822d407d9195e51 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251215 20:53:38.052768 3802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e9420df6384a1f9822d407d9195e51. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:53:38.038442 3778 leader_election.cc:343] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.056833 4006 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.060966 3950 tablet_service.cc:1505] Processing CreateTablet for tablet b302275303b54dc3a70558581fd3ae49 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20251215 20:53:38.064275 3633 catalog_manager.cc:5654] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.069463 3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302275303b54dc3a70558581fd3ae49. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.065121 4005 tablet_bootstrap.cc:654] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.075233 4010 ts_tablet_manager.cc:1434] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.069s user 0.006s sys 0.000s
I20251215 20:53:38.087610 3873 tablet_service.cc:1505] Processing CreateTablet for tablet b5e9420df6384a1f9822d407d9195e51 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251215 20:53:38.076282 4010 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.093811 3873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e9420df6384a1f9822d407d9195e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.094821 3947 tablet_service.cc:1505] Processing CreateTablet for tablet b5e9420df6384a1f9822d407d9195e51 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20251215 20:53:38.100916 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e9420df6384a1f9822d407d9195e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.101508 3727 tablet_service.cc:1505] Processing CreateTablet for tablet a923d91e17724167884e844da2f5a737 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251215 20:53:38.105770 4012 raft_consensus.cc:493] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.106096 3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a923d91e17724167884e844da2f5a737. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.106274 4012 raft_consensus.cc:515] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.108079 3795 tablet_service.cc:1505] Processing CreateTablet for tablet a923d91e17724167884e844da2f5a737 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251215 20:53:38.109107 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.109472 3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a923d91e17724167884e844da2f5a737. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.109748 3813 raft_consensus.cc:2468] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:38.110091 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.110863 3927 leader_election.cc:304] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
W20251215 20:53:38.111593 3926 leader_election.cc:343] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.112187 4041 raft_consensus.cc:2804] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.112648 4006 tablet_bootstrap.cc:654] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:38.114694 3927 consensus_peers.cc:597] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:38.112591 4041 raft_consensus.cc:493] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.115388 4041 raft_consensus.cc:3060] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.115918 4010 tablet_bootstrap.cc:654] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.109046 4012 leader_election.cc:290] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.126901 3945 tablet_service.cc:1505] Processing CreateTablet for tablet 61227fed983e4c8ca9490bf84294f86d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251215 20:53:38.128116 3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61227fed983e4c8ca9490bf84294f86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.136224 4040 raft_consensus.cc:493] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.136749 4040 raft_consensus.cc:515] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.138633 4040 leader_election.cc:290] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:38.144495 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b7e4d145d7c4085b7ad7d3578605d5c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:38.148718 3737 raft_consensus.cc:2468] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:38.140959 3872 tablet_service.cc:1505] Processing CreateTablet for tablet a923d91e17724167884e844da2f5a737 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20251215 20:53:38.150111 3872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a923d91e17724167884e844da2f5a737. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.150683 3777 leader_election.cc:304] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:38.153743 4040 raft_consensus.cc:2804] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.153299 3633 catalog_manager.cc:5654] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.154142 4040 raft_consensus.cc:493] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.154008 4041 raft_consensus.cc:515] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.155521 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.156337 3961 raft_consensus.cc:2393] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:38.156546 4041 leader_election.cc:290] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.140621 3801 tablet_service.cc:1505] Processing CreateTablet for tablet 61227fed983e4c8ca9490bf84294f86d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251215 20:53:38.157227 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b7e4d145d7c4085b7ad7d3578605d5c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.157805 3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61227fed983e4c8ca9490bf84294f86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.159588 4007 tablet_bootstrap.cc:492] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.160089 4007 ts_tablet_manager.cc:1403] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.187s user 0.012s sys 0.000s
I20251215 20:53:38.161088 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:38.170607 3926 leader_election.cc:343] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.161739 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:38.162241 3779 leader_election.cc:304] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.171396 3813 raft_consensus.cc:3060] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.164032 3719 tablet_service.cc:1505] Processing CreateTablet for tablet 61227fed983e4c8ca9490bf84294f86d (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20251215 20:53:38.164204 3870 tablet_service.cc:1505] Processing CreateTablet for tablet 10876eda60774113b16eca9ad870db31 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251215 20:53:38.154589 4040 raft_consensus.cc:3060] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.177994 4007 raft_consensus.cc:359] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.178761 4007 raft_consensus.cc:385] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.180164 3870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10876eda60774113b16eca9ad870db31. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 20:53:38.181799 3779 leader_election.cc:343] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.185237 3947 tablet_service.cc:1505] Processing CreateTablet for tablet 10876eda60774113b16eca9ad870db31 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251215 20:53:38.187989 3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10876eda60774113b16eca9ad870db31. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.191397 4005 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:38.191884 4005 ts_tablet_manager.cc:1403] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.163s user 0.014s sys 0.037s
I20251215 20:53:38.192492 4040 raft_consensus.cc:515] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.194526 4005 raft_consensus.cc:359] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.200448 4005 raft_consensus.cc:385] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.200762 3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61227fed983e4c8ca9490bf84294f86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.202400 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b7e4d145d7c4085b7ad7d3578605d5c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:38.199709 4041 consensus_queue.cc:1048] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:53:38.203723 3779 leader_election.cc:343] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.205401 4040 leader_election.cc:290] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:38.187378 4007 raft_consensus.cc:740] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.205782 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b7e4d145d7c4085b7ad7d3578605d5c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:38.206346 3737 raft_consensus.cc:3060] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.200738 4005 raft_consensus.cc:740] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.207397 4005 consensus_queue.cc:260] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.206708 4007 consensus_queue.cc:260] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.211663 4005 ts_tablet_manager.cc:1434] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.020s user 0.004s sys 0.004s
I20251215 20:53:38.211617 3727 tablet_service.cc:1505] Processing CreateTablet for tablet 10876eda60774113b16eca9ad870db31 (DEFAULT_TABLE table=test-workload [id=0bc9d5bd2fe743829ea6028e349bcc46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20251215 20:53:38.213016 4007 ts_tablet_manager.cc:1434] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.048s user 0.008s sys 0.000s
I20251215 20:53:38.214067 4007 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:38.212514 3813 raft_consensus.cc:2468] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:38.216436 3737 raft_consensus.cc:2468] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:38.216748 4016 raft_consensus.cc:2749] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.212576 4005 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.217603 3777 leader_election.cc:304] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.221837 3927 leader_election.cc:304] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.222604 4041 raft_consensus.cc:2804] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.223040 4016 raft_consensus.cc:2804] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.223528 4016 raft_consensus.cc:697] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:38.223835 4005 tablet_bootstrap.cc:654] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.223074 4041 raft_consensus.cc:697] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:38.224700 4016 consensus_queue.cc:237] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.227336 3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10876eda60774113b16eca9ad870db31. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:53:38.224745 4041 consensus_queue.cc:237] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.250447 4006 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.250957 4006 ts_tablet_manager.cc:1403] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.194s user 0.016s sys 0.021s
I20251215 20:53:38.259421 4006 raft_consensus.cc:359] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.261554 4006 raft_consensus.cc:385] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.262059 4006 raft_consensus.cc:740] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.261184 3633 catalog_manager.cc:5654] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.262806 4006 consensus_queue.cc:260] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.263899 4007 tablet_bootstrap.cc:654] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.266220 4010 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.266745 4010 ts_tablet_manager.cc:1403] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.191s user 0.014s sys 0.016s
I20251215 20:53:38.267411 4006 ts_tablet_manager.cc:1434] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.016s user 0.005s sys 0.004s
I20251215 20:53:38.270371 4006 tablet_bootstrap.cc:492] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.273376 4016 consensus_queue.cc:1048] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:38.279842 4010 raft_consensus.cc:359] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.286300 4010 raft_consensus.cc:385] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.286593 4010 raft_consensus.cc:740] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.290750 4010 consensus_queue.cc:260] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.291216 4058 raft_consensus.cc:493] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.290926 3635 catalog_manager.cc:5654] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:38.291745 4058 raft_consensus.cc:515] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.293757 4058 leader_election.cc:290] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.294934 4005 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:38.295070 4006 tablet_bootstrap.cc:654] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.295392 4005 ts_tablet_manager.cc:1403] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.083s user 0.010s sys 0.000s
I20251215 20:53:38.295795 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.297117 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.298044 3813 raft_consensus.cc:2393] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:38.299850 4016 raft_consensus.cc:493] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.300047 3853 leader_election.cc:304] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.300639 4016 raft_consensus.cc:515] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.301515 4058 raft_consensus.cc:3060] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.302520 4016 leader_election.cc:290] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.299526 4010 ts_tablet_manager.cc:1434] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.033s user 0.006s sys 0.001s
I20251215 20:53:38.303858 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:38.306926 4016 consensus_queue.cc:1048] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.312975 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.314632 3887 raft_consensus.cc:2393] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:38.297899 4005 raft_consensus.cc:359] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.316788 4005 raft_consensus.cc:385] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.317087 4005 raft_consensus.cc:740] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.317735 4005 consensus_queue.cc:260] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.318150 3778 leader_election.cc:304] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.318912 4010 tablet_bootstrap.cc:492] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.319464 4016 raft_consensus.cc:3060] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.320001 4005 ts_tablet_manager.cc:1434] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20251215 20:53:38.321090 4005 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.322590 4007 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.323134 4007 ts_tablet_manager.cc:1403] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.109s user 0.015s sys 0.002s
I20251215 20:53:38.325853 4007 raft_consensus.cc:359] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.326534 4007 raft_consensus.cc:385] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.326814 4007 raft_consensus.cc:740] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.328078 4016 raft_consensus.cc:2749] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.315999 4058 raft_consensus.cc:2749] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.331974 4007 consensus_queue.cc:260] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.333056 4005 tablet_bootstrap.cc:654] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.337525 4010 tablet_bootstrap.cc:654] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.337541 4007 ts_tablet_manager.cc:1434] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20251215 20:53:38.338672 4007 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:38.344823 4007 tablet_bootstrap.cc:654] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.357177 4007 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.357625 4007 ts_tablet_manager.cc:1403] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.002s
I20251215 20:53:38.359274 4006 tablet_bootstrap.cc:492] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.359953 4041 raft_consensus.cc:493] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.359794 4006 ts_tablet_manager.cc:1403] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.090s user 0.031s sys 0.034s
I20251215 20:53:38.360430 4041 raft_consensus.cc:515] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.362568 4041 leader_election.cc:290] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:38.363533 4006 raft_consensus.cc:359] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.364320 4006 raft_consensus.cc:385] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.364712 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01cbaf89fd054f4cb0385b533fae6f8c" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.360409 4007 raft_consensus.cc:359] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.364786 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01cbaf89fd054f4cb0385b533fae6f8c" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:38.364692 4006 raft_consensus.cc:740] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.365808 3737 raft_consensus.cc:2468] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
W20251215 20:53:38.366024 3927 leader_election.cc:343] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.365398 4007 raft_consensus.cc:385] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.366849 4007 raft_consensus.cc:740] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.366847 3925 leader_election.cc:304] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:38.366609 4006 consensus_queue.cc:260] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.367760 4007 consensus_queue.cc:260] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.368167 4041 raft_consensus.cc:2804] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.368577 4041 raft_consensus.cc:493] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.368902 4041 raft_consensus.cc:3060] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.374181 4005 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:38.374630 4005 ts_tablet_manager.cc:1403] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.000s
I20251215 20:53:38.374560 4006 ts_tablet_manager.cc:1434] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20251215 20:53:38.375907 4006 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.376922 4005 raft_consensus.cc:359] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.377614 4005 raft_consensus.cc:385] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.377868 4005 raft_consensus.cc:740] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.378477 4005 consensus_queue.cc:260] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.382640 4005 ts_tablet_manager.cc:1434] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:53:38.383548 4005 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.383634 4006 tablet_bootstrap.cc:654] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.387924 4006 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.388403 4006 ts_tablet_manager.cc:1403] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20251215 20:53:38.380659 4010 tablet_bootstrap.cc:492] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.389439 4010 ts_tablet_manager.cc:1403] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.071s user 0.015s sys 0.000s
I20251215 20:53:38.390682 4046 raft_consensus.cc:493] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.391119 4046 raft_consensus.cc:515] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.391134 4006 raft_consensus.cc:359] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.392089 4006 raft_consensus.cc:385] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.392436 4006 raft_consensus.cc:740] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.394140 4010 raft_consensus.cc:359] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.394816 4010 raft_consensus.cc:385] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.394958 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.395140 4010 raft_consensus.cc:740] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
W20251215 20:53:38.396347 3703 leader_election.cc:343] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.393090 4046 leader_election.cc:290] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.396452 4010 consensus_queue.cc:260] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.390374 4041 raft_consensus.cc:515] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.396430 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.397994 3813 raft_consensus.cc:2468] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:38.399756 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01cbaf89fd054f4cb0385b533fae6f8c" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:38.400336 3704 leader_election.cc:304] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254
W20251215 20:53:38.400936 3927 leader_election.cc:343] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.401099 4046 raft_consensus.cc:2804] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.401507 4046 raft_consensus.cc:493] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.393164 4006 consensus_queue.cc:260] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.401830 4046 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.402168 4007 ts_tablet_manager.cc:1434] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.044s user 0.008s sys 0.000s
I20251215 20:53:38.402531 4041 leader_election.cc:290] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:38.403086 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01cbaf89fd054f4cb0385b533fae6f8c" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:38.403618 4006 ts_tablet_manager.cc:1434] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20251215 20:53:38.404258 4005 tablet_bootstrap.cc:654] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.404572 4006 tablet_bootstrap.cc:492] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.403650 4007 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:38.410826 4010 ts_tablet_manager.cc:1434] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20251215 20:53:38.411873 4010 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.414625 4007 tablet_bootstrap.cc:654] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.403618 3737 raft_consensus.cc:3060] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.417243 4006 tablet_bootstrap.cc:654] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.418048 4010 tablet_bootstrap.cc:654] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.421783 4046 raft_consensus.cc:515] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.423534 3737 raft_consensus.cc:2468] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:38.425211 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:38.427145 3703 leader_election.cc:343] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.428717 4046 leader_election.cc:290] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.431209 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:38.431789 3813 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.432693 4005 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:38.433169 4005 ts_tablet_manager.cc:1403] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.005s
I20251215 20:53:38.435738 4005 raft_consensus.cc:359] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.436416 4005 raft_consensus.cc:385] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.436728 4005 raft_consensus.cc:740] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.437361 4005 consensus_queue.cc:260] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.439661 4005 ts_tablet_manager.cc:1434] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:53:38.430445 3925 leader_election.cc:304] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:38.440795 4041 raft_consensus.cc:2804] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.441320 4041 raft_consensus.cc:697] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:38.442139 4041 consensus_queue.cc:237] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.446324 3813 raft_consensus.cc:2468] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:38.447160 4005 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.447551 3704 leader_election.cc:304] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.448478 4046 raft_consensus.cc:2804] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.448979 4046 raft_consensus.cc:697] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:38.449820 4046 consensus_queue.cc:237] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.452646 4040 raft_consensus.cc:493] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.453184 4040 raft_consensus.cc:515] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.455257 4040 leader_election.cc:290] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.456800 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "57d49107996447828d7fc624dba56e4d" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.459563 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "57d49107996447828d7fc624dba56e4d" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.460701 4005 tablet_bootstrap.cc:654] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.461658 3779 leader_election.cc:304] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.462777 4040 raft_consensus.cc:2749] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.470603 3634 catalog_manager.cc:5654] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.474275 4010 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.474915 4010 ts_tablet_manager.cc:1403] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.006s
I20251215 20:53:38.477489 4010 raft_consensus.cc:359] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.478077 4010 raft_consensus.cc:385] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.478338 4010 raft_consensus.cc:740] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.479526 4010 consensus_queue.cc:260] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.479151 3633 catalog_manager.cc:5654] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.474512 4005 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:38.483330 4005 ts_tablet_manager.cc:1403] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.000s
I20251215 20:53:38.483903 4046 consensus_queue.cc:1048] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.485847 4005 raft_consensus.cc:359] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.486491 4005 raft_consensus.cc:385] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.486733 4005 raft_consensus.cc:740] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.487330 4005 consensus_queue.cc:260] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.489279 4005 ts_tablet_manager.cc:1434] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:38.489583 4010 ts_tablet_manager.cc:1434] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20251215 20:53:38.490193 4005 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.491648 4006 tablet_bootstrap.cc:492] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.492074 4006 ts_tablet_manager.cc:1403] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.088s user 0.021s sys 0.021s
I20251215 20:53:38.495744 4005 tablet_bootstrap.cc:654] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.495464 4006 raft_consensus.cc:359] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.496145 4006 raft_consensus.cc:385] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.496460 4006 raft_consensus.cc:740] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.497416 4010 tablet_bootstrap.cc:492] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.498561 4046 raft_consensus.cc:493] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.499049 4046 raft_consensus.cc:515] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.500875 4011 raft_consensus.cc:493] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.501367 4011 raft_consensus.cc:515] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.501924 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6ccd6add84b428eb601968b0547c5a6" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
W20251215 20:53:38.503352 3704 leader_election.cc:343] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.503404 4011 leader_election.cc:290] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.504531 4010 tablet_bootstrap.cc:654] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.504566 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87b34b8adfa44d8680e7f070cad3428c" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.504913 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87b34b8adfa44d8680e7f070cad3428c" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
W20251215 20:53:38.506019 3703 leader_election.cc:343] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:38.506646 3704 leader_election.cc:343] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.507069 4011 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.506578 4046 leader_election.cc:290] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.507501 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6ccd6add84b428eb601968b0547c5a6" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.507683 4011 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.509924 4011 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
W20251215 20:53:38.511893 3703 leader_election.cc:343] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.507508 3704 leader_election.cc:304] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.512146 4006 consensus_queue.cc:260] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.513101 4011 raft_consensus.cc:2749] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.514132 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.514721 3960 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:38.514883 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.515379 4005 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:38.515761 3703 leader_election.cc:304] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.515944 4005 ts_tablet_manager.cc:1403] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.004s
I20251215 20:53:38.517643 4011 raft_consensus.cc:2749] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.515467 3813 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:38.519279 3704 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:38.521023 3813 raft_consensus.cc:3060] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.522657 4006 ts_tablet_manager.cc:1434] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20251215 20:53:38.523408 4010 tablet_bootstrap.cc:492] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.523723 4010 ts_tablet_manager.cc:1403] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.020s
I20251215 20:53:38.524633 4011 raft_consensus.cc:2804] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.525014 4011 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.525364 4011 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.525828 4007 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.527001 4041 consensus_queue.cc:1048] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:38.527043 4010 raft_consensus.cc:359] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.527815 4010 raft_consensus.cc:385] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.528085 4010 raft_consensus.cc:740] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.528086 4007 ts_tablet_manager.cc:1403] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.125s user 0.027s sys 0.027s
I20251215 20:53:38.528828 4010 consensus_queue.cc:260] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.530012 4006 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.532251 4007 raft_consensus.cc:359] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.532917 4007 raft_consensus.cc:385] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.533198 4007 raft_consensus.cc:740] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.533605 4011 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.535573 4011 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:38.536974 4005 raft_consensus.cc:359] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.537607 4005 raft_consensus.cc:385] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.537866 4005 raft_consensus.cc:740] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.533924 4007 consensus_queue.cc:260] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.538455 4005 consensus_queue.cc:260] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.540678 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:38.541261 3960 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.542871 4007 ts_tablet_manager.cc:1434] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20251215 20:53:38.543845 4007 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:38.546169 4006 tablet_bootstrap.cc:654] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.547734 4010 ts_tablet_manager.cc:1434] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20251215 20:53:38.548337 3960 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:38.548697 4010 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.550215 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:38.552608 3812 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.552989 4007 tablet_bootstrap.cc:654] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.555198 4040 raft_consensus.cc:493] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.555684 4040 raft_consensus.cc:515] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.557612 4040 leader_election.cc:290] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:38.559103 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01cbaf89fd054f4cb0385b533fae6f8c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.559751 4010 tablet_bootstrap.cc:654] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.559159 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01cbaf89fd054f4cb0385b533fae6f8c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:38.560856 3737 raft_consensus.cc:2393] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:38.565919 3704 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:38.568985 4011 raft_consensus.cc:2804] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.565991 3812 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:38.579546 4058 raft_consensus.cc:493] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.582891 4005 ts_tablet_manager.cc:1434] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.064s user 0.009s sys 0.003s
I20251215 20:53:38.584493 4005 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.586548 4006 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.587033 4006 ts_tablet_manager.cc:1403] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.057s user 0.013s sys 0.001s
I20251215 20:53:38.580049 4058 raft_consensus.cc:515] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.588069 3886 raft_consensus.cc:3060] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.588723 4058 leader_election.cc:290] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:38.584934 4046 consensus_queue.cc:1048] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20251215 20:53:38.589706 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a40f55e64934e3384ce7a7e98833ebc" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.590466 3779 leader_election.cc:304] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.591248 4040 raft_consensus.cc:3060] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.581617 4011 raft_consensus.cc:697] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
W20251215 20:53:38.591461 3853 leader_election.cc:343] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.590845 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a40f55e64934e3384ce7a7e98833ebc" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:38.592533 3738 raft_consensus.cc:2468] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:38.592166 4011 consensus_queue.cc:237] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.593684 3851 leader_election.cc:304] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.592762 4006 raft_consensus.cc:359] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.596966 4006 raft_consensus.cc:385] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.597229 4006 raft_consensus.cc:740] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.603101 4040 raft_consensus.cc:2749] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.604084 4006 consensus_queue.cc:260] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.586509 4007 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.605432 4007 ts_tablet_manager.cc:1403] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.062s user 0.008s sys 0.008s
I20251215 20:53:38.606859 4058 raft_consensus.cc:2804] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.607232 4058 raft_consensus.cc:493] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.607576 4058 raft_consensus.cc:3060] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.609395 4007 raft_consensus.cc:359] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.610620 4007 raft_consensus.cc:385] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.611248 4006 ts_tablet_manager.cc:1434] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20251215 20:53:38.611213 4007 raft_consensus.cc:740] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.611212 4012 consensus_queue.cc:1048] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:38.612345 4006 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.612922 4007 consensus_queue.cc:260] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.619493 4005 tablet_bootstrap.cc:654] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.622756 4012 consensus_queue.cc:1048] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:38.628005 3634 catalog_manager.cc:5654] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.629510 4006 tablet_bootstrap.cc:654] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.631675 4058 raft_consensus.cc:515] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.639669 4007 ts_tablet_manager.cc:1434] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.034s user 0.008s sys 0.004s
I20251215 20:53:38.641273 4058 leader_election.cc:290] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:38.641280 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a40f55e64934e3384ce7a7e98833ebc" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
W20251215 20:53:38.642751 3853 leader_election.cc:343] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.643620 4007 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:38.645650 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a40f55e64934e3384ce7a7e98833ebc" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:38.647454 4010 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.647887 4010 ts_tablet_manager.cc:1403] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.099s user 0.011s sys 0.001s
I20251215 20:53:38.647730 4040 consensus_queue.cc:1048] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.650295 4010 raft_consensus.cc:359] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.650908 4010 raft_consensus.cc:385] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.651157 4010 raft_consensus.cc:740] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.652490 4010 consensus_queue.cc:260] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.646430 3737 raft_consensus.cc:3060] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.658031 4010 ts_tablet_manager.cc:1434] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.010s user 0.001s sys 0.006s
I20251215 20:53:38.661427 4043 consensus_queue.cc:1048] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.669867 4010 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.672145 3960 raft_consensus.cc:3060] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.675531 3737 raft_consensus.cc:2468] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:38.676540 3851 leader_election.cc:304] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.677302 4107 raft_consensus.cc:2804] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.677753 4107 raft_consensus.cc:697] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:38.678514 4107 consensus_queue.cc:237] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.684129 4041 raft_consensus.cc:493] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.684731 4007 tablet_bootstrap.cc:654] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.684636 4041 raft_consensus.cc:515] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.686453 4041 leader_election.cc:290] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.692703 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6888cc3ab31a4688a8fdda25f79dc586" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.693200 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6888cc3ab31a4688a8fdda25f79dc586" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:38.694430 3927 leader_election.cc:343] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:38.697558 3926 leader_election.cc:343] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.697981 3926 leader_election.cc:304] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.699087 4043 raft_consensus.cc:2749] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.702107 4010 tablet_bootstrap.cc:654] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.703117 4040 consensus_queue.cc:1048] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.707168 4011 raft_consensus.cc:493] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.707646 4011 raft_consensus.cc:515] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.712041 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.712692 3813 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:38.713912 3704 leader_election.cc:304] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:38.714862 4103 raft_consensus.cc:2804] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.715204 4103 raft_consensus.cc:493] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.715507 4103 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.720228 4011 leader_election.cc:290] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.725119 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.727430 3885 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:38.732816 4005 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:38.733309 4005 ts_tablet_manager.cc:1403] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.150s user 0.009s sys 0.004s
I20251215 20:53:38.733475 4107 raft_consensus.cc:493] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.733940 4107 raft_consensus.cc:515] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.735849 4005 raft_consensus.cc:359] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.735845 4107 leader_election.cc:290] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:38.737923 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.739408 4043 raft_consensus.cc:493] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.741562 4043 raft_consensus.cc:515] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.742187 3813 raft_consensus.cc:2393] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:38.743099 4006 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.743590 4006 ts_tablet_manager.cc:1403] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.131s user 0.011s sys 0.008s
I20251215 20:53:38.740074 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:38.741142 4005 raft_consensus.cc:385] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.744099 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:38.744761 4005 raft_consensus.cc:740] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.746328 4005 consensus_queue.cc:260] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.747242 3738 raft_consensus.cc:2468] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:38.745580 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
W20251215 20:53:38.748687 3927 leader_election.cc:343] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.749310 4006 raft_consensus.cc:359] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.749924 4006 raft_consensus.cc:385] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.750159 4006 raft_consensus.cc:740] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.744160 4043 leader_election.cc:290] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:38.738029 3633 catalog_manager.cc:5654] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.750891 4006 consensus_queue.cc:260] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.751772 4007 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.752192 4007 ts_tablet_manager.cc:1403] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.109s user 0.012s sys 0.014s
I20251215 20:53:38.753829 4010 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.753638 3851 leader_election.cc:304] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:38.761029 4107 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.762077 4007 raft_consensus.cc:359] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.762724 4007 raft_consensus.cc:385] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.762984 4007 raft_consensus.cc:740] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.763593 4007 consensus_queue.cc:260] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.765578 4007 ts_tablet_manager.cc:1434] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20251215 20:53:38.768932 4007 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:38.754297 3925 leader_election.cc:304] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:38.770377 4043 raft_consensus.cc:2804] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.770733 4043 raft_consensus.cc:493] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.771049 4043 raft_consensus.cc:3060] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.774338 4107 raft_consensus.cc:2749] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.757831 4005 ts_tablet_manager.cc:1434] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20251215 20:53:38.758611 4103 raft_consensus.cc:515] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.759677 4006 ts_tablet_manager.cc:1434] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20251215 20:53:38.775586 4006 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.776892 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:38.777441 3813 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.779302 4043 raft_consensus.cc:515] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.780809 4006 tablet_bootstrap.cc:654] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.774528 4007 tablet_bootstrap.cc:654] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:38.782544 3684 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:53:38.783851 4005 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.785053 3813 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:38.786761 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:38.788589 3886 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.789530 4005 tablet_bootstrap.cc:654] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.792272 4010 ts_tablet_manager.cc:1403] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.123s user 0.015s sys 0.010s
I20251215 20:53:38.792932 4006 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.793356 4006 ts_tablet_manager.cc:1403] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.003s
I20251215 20:53:38.794754 4010 raft_consensus.cc:359] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.795409 4010 raft_consensus.cc:385] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.795500 4107 raft_consensus.cc:493] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.787204 4103 leader_election.cc:290] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.795707 4010 raft_consensus.cc:740] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.795631 4006 raft_consensus.cc:359] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.796391 4010 consensus_queue.cc:260] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.796989 4006 raft_consensus.cc:385] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.797401 4006 raft_consensus.cc:740] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.797667 3704 leader_election.cc:304] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:38.798282 4007 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.798038 4006 consensus_queue.cc:260] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.798710 4007 ts_tablet_manager.cc:1403] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.001s
I20251215 20:53:38.799284 4043 leader_election.cc:290] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:38.799348 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:38.799989 3738 raft_consensus.cc:3060] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.800451 4006 ts_tablet_manager.cc:1434] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20251215 20:53:38.801491 4006 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.801187 4007 raft_consensus.cc:359] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.801891 4007 raft_consensus.cc:385] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.802156 4007 raft_consensus.cc:740] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.802837 4007 consensus_queue.cc:260] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.800637 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
W20251215 20:53:38.806725 3927 leader_election.cc:343] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.807085 4006 tablet_bootstrap.cc:654] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.807699 4007 ts_tablet_manager.cc:1434] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.009s user 0.002s sys 0.005s
I20251215 20:53:38.808620 4007 tablet_bootstrap.cc:492] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:38.811676 3738 raft_consensus.cc:2468] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:38.812841 3925 leader_election.cc:304] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:38.813922 4007 tablet_bootstrap.cc:654] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.814270 4103 raft_consensus.cc:2804] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.815261 4012 raft_consensus.cc:2804] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.815742 4012 raft_consensus.cc:697] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:38.816562 4012 consensus_queue.cc:237] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.818807 4041 raft_consensus.cc:493] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.813606 4107 raft_consensus.cc:515] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.819269 4041 raft_consensus.cc:515] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.821141 4041 leader_election.cc:290] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:38.822576 4006 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.823094 4006 ts_tablet_manager.cc:1403] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.008s
I20251215 20:53:38.823839 4107 leader_election.cc:290] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.824525 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87b34b8adfa44d8680e7f070cad3428c" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.825258 4010 ts_tablet_manager.cc:1434] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.033s user 0.003s sys 0.003s
I20251215 20:53:38.825824 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87b34b8adfa44d8680e7f070cad3428c" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
W20251215 20:53:38.825783 3926 leader_election.cc:343] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.825758 4103 raft_consensus.cc:697] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:38.796571 3886 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:38.825307 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.827343 3960 raft_consensus.cc:2393] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:38.827913 4103 consensus_queue.cc:237] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:38.826438 3737 raft_consensus.cc:2468] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:38.829747 3925 leader_election.cc:304] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.831009 4043 raft_consensus.cc:2804] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.831434 4043 raft_consensus.cc:493] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.833491 4043 raft_consensus.cc:3060] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.836470 4010 tablet_bootstrap.cc:492] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.831954 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:38.837265 3738 raft_consensus.cc:2393] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:38.832773 4006 raft_consensus.cc:359] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.838001 4006 raft_consensus.cc:385] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.838143 3851 leader_election.cc:304] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:38.838346 4006 raft_consensus.cc:740] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.839182 4107 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.839047 4006 consensus_queue.cc:260] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.845952 3633 catalog_manager.cc:5654] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.847713 4011 consensus_queue.cc:1048] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.848162 4006 ts_tablet_manager.cc:1434] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.025s user 0.002s sys 0.003s
I20251215 20:53:38.849169 4006 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.849766 4012 raft_consensus.cc:493] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.849982 4010 tablet_bootstrap.cc:654] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.852670 4040 raft_consensus.cc:493] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.853132 4040 raft_consensus.cc:515] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.836428 4007 tablet_bootstrap.cc:492] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.854331 4007 ts_tablet_manager.cc:1403] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.008s
I20251215 20:53:38.854919 4006 tablet_bootstrap.cc:654] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.854987 4040 leader_election.cc:290] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.845872 4043 raft_consensus.cc:515] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.845872 4107 raft_consensus.cc:2749] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.856022 3634 catalog_manager.cc:5654] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.856956 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4219e2b494847c4b98c41a4181cbcc0" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.858888 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4219e2b494847c4b98c41a4181cbcc0" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.859066 4043 leader_election.cc:290] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:38.859265 4012 raft_consensus.cc:515] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.859779 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87b34b8adfa44d8680e7f070cad3428c" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:38.860193 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87b34b8adfa44d8680e7f070cad3428c" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:38.860810 3738 raft_consensus.cc:3060] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:38.861128 3926 leader_election.cc:343] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.862035 4007 raft_consensus.cc:359] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.862668 4007 raft_consensus.cc:385] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.862905 4007 raft_consensus.cc:740] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.865603 3960 raft_consensus.cc:2468] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:38.867437 3779 leader_election.cc:304] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:38.867089 4007 consensus_queue.cc:260] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.868574 3738 raft_consensus.cc:2468] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:38.868703 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4219e2b494847c4b98c41a4181cbcc0" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:38.869329 3813 raft_consensus.cc:2468] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:38.869802 3925 leader_election.cc:304] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.870368 3927 leader_election.cc:304] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:38.871196 4041 consensus_queue.cc:1048] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.872368 4041 raft_consensus.cc:2804] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.872772 4041 raft_consensus.cc:697] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:38.873376 4005 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:38.873775 3887 raft_consensus.cc:2468] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:38.873523 4041 consensus_queue.cc:237] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.872327 4040 raft_consensus.cc:2804] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.876106 4040 raft_consensus.cc:493] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.876541 4040 raft_consensus.cc:3060] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.877358 4012 leader_election.cc:290] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.877862 4012 raft_consensus.cc:2804] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.878183 4012 raft_consensus.cc:493] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.878509 4012 raft_consensus.cc:3060] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.880059 4005 ts_tablet_manager.cc:1403] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.096s user 0.007s sys 0.008s
I20251215 20:53:38.882745 4005 raft_consensus.cc:359] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.882905 4011 consensus_queue.cc:1048] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.883391 4005 raft_consensus.cc:385] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.883675 4005 raft_consensus.cc:740] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.884593 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4219e2b494847c4b98c41a4181cbcc0" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:38.885203 3885 raft_consensus.cc:2468] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:38.884253 4005 consensus_queue.cc:260] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.888541 4040 raft_consensus.cc:515] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.891917 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4219e2b494847c4b98c41a4181cbcc0" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:38.892485 3885 raft_consensus.cc:3060] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.893509 4007 ts_tablet_manager.cc:1434] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.039s user 0.003s sys 0.002s
I20251215 20:53:38.894398 4007 tablet_bootstrap.cc:492] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:38.894488 4005 ts_tablet_manager.cc:1434] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20251215 20:53:38.896653 4040 leader_election.cc:290] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.927132 4005 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:38.929013 3885 raft_consensus.cc:2468] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:38.930306 3778 leader_election.cc:304] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:38.931157 4040 raft_consensus.cc:2804] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:38.931605 4040 raft_consensus.cc:697] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:38.931915 4007 tablet_bootstrap.cc:654] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.932332 4103 raft_consensus.cc:493] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:38.932403 4040 consensus_queue.cc:237] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.932875 4103 raft_consensus.cc:515] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.935081 4010 tablet_bootstrap.cc:492] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.935541 4010 ts_tablet_manager.cc:1403] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.099s user 0.015s sys 0.002s
I20251215 20:53:38.935549 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:38.937007 3703 leader_election.cc:343] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.938184 4010 raft_consensus.cc:359] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.938587 4103 leader_election.cc:290] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.938827 4010 raft_consensus.cc:385] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.939158 4010 raft_consensus.cc:740] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.939726 4006 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.940147 4006 ts_tablet_manager.cc:1403] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.091s user 0.015s sys 0.000s
I20251215 20:53:38.939881 4010 consensus_queue.cc:260] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.940243 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:38.940963 3960 raft_consensus.cc:2468] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:38.942207 4010 ts_tablet_manager.cc:1434] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20251215 20:53:38.942808 4006 raft_consensus.cc:359] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.943073 4010 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.942997 3704 leader_election.cc:304] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.943459 4006 raft_consensus.cc:385] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.943758 4006 raft_consensus.cc:740] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.944607 4006 consensus_queue.cc:260] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.946584 4006 ts_tablet_manager.cc:1434] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:38.947410 4006 tablet_bootstrap.cc:492] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:38.948894 4103 raft_consensus.cc:2804] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:38.949276 4103 raft_consensus.cc:493] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:38.949606 4103 raft_consensus.cc:3060] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.953058 4010 tablet_bootstrap.cc:654] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.958907 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4219e2b494847c4b98c41a4181cbcc0" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:38.959621 4006 tablet_bootstrap.cc:654] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.963232 4012 raft_consensus.cc:515] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.963768 4010 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:38.964273 4010 ts_tablet_manager.cc:1403] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.000s
I20251215 20:53:38.967912 3634 catalog_manager.cc:5654] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:38.969202 4010 raft_consensus.cc:359] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.969897 4010 raft_consensus.cc:385] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.969983 3960 raft_consensus.cc:2393] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:38.970853 4012 leader_election.cc:290] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:38.959990 4103 raft_consensus.cc:515] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:38.971880 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4219e2b494847c4b98c41a4181cbcc0" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:38.972630 3885 raft_consensus.cc:2393] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:38.973070 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4219e2b494847c4b98c41a4181cbcc0" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:38.973382 4010 raft_consensus.cc:740] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.973794 4103 leader_election.cc:290] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:38.969143 4005 tablet_bootstrap.cc:654] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:38.975890 4007 tablet_bootstrap.cc:492] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:38.975752 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:38.976460 4007 ts_tablet_manager.cc:1403] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.082s user 0.016s sys 0.014s
I20251215 20:53:38.976533 3960 raft_consensus.cc:3060] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:38.975706 3926 leader_election.cc:304] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:38.978014 4012 raft_consensus.cc:2749] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:38.977236 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:38.979503 3703 leader_election.cc:343] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:38.984367 4006 tablet_bootstrap.cc:492] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:38.984210 4007 raft_consensus.cc:359] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.984899 4007 raft_consensus.cc:385] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.985289 4007 raft_consensus.cc:740] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.985814 4007 consensus_queue.cc:260] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.987615 4007 ts_tablet_manager.cc:1434] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20251215 20:53:38.984941 4006 ts_tablet_manager.cc:1403] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.003s
I20251215 20:53:38.990108 4006 raft_consensus.cc:359] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.990685 4006 raft_consensus.cc:385] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:38.990926 4006 raft_consensus.cc:740] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:38.991479 4006 consensus_queue.cc:260] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:38.974128 4010 consensus_queue.cc:260] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:38.994184 4010 ts_tablet_manager.cc:1434] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.030s user 0.005s sys 0.000s
I20251215 20:53:38.994644 4041 consensus_queue.cc:1048] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:38.995005 4010 tablet_bootstrap.cc:492] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:38.996356 3633 catalog_manager.cc:5654] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:39.001055 4007 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:39.001176 3960 raft_consensus.cc:2468] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:39.002285 3704 leader_election.cc:304] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.003041 4103 raft_consensus.cc:2804] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.002441 4006 ts_tablet_manager.cc:1434] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.014s user 0.002s sys 0.002s
I20251215 20:53:39.004513 4006 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.008185 4007 tablet_bootstrap.cc:654] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.004546 4103 raft_consensus.cc:697] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:39.009474 4103 consensus_queue.cc:237] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.011130 4010 tablet_bootstrap.cc:654] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.020644 4006 tablet_bootstrap.cc:654] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.026824 4010 tablet_bootstrap.cc:492] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:39.027328 4010 ts_tablet_manager.cc:1403] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.000s
I20251215 20:53:39.029799 4010 raft_consensus.cc:359] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.030706 4010 raft_consensus.cc:385] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.031008 4010 raft_consensus.cc:740] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.031735 4010 consensus_queue.cc:260] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.034132 4010 ts_tablet_manager.cc:1434] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:39.035192 4010 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:39.035779 4006 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.036222 4006 ts_tablet_manager.cc:1403] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.002s
I20251215 20:53:39.038564 4006 raft_consensus.cc:359] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.039170 4006 raft_consensus.cc:385] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.039345 4005 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.039436 4006 raft_consensus.cc:740] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.039987 4005 ts_tablet_manager.cc:1403] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.113s user 0.016s sys 0.003s
I20251215 20:53:39.040283 4006 consensus_queue.cc:260] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.042589 4006 ts_tablet_manager.cc:1434] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:39.042316 4005 raft_consensus.cc:359] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.042932 4005 raft_consensus.cc:385] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.043216 4005 raft_consensus.cc:740] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.043471 4006 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.043903 4005 consensus_queue.cc:260] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.046100 4005 ts_tablet_manager.cc:1434] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:39.046938 4005 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.049198 4006 tablet_bootstrap.cc:654] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.055698 4005 tablet_bootstrap.cc:654] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.059566 4107 raft_consensus.cc:493] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.060065 4107 raft_consensus.cc:515] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.062080 4107 leader_election.cc:290] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.067356 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6ccd6add84b428eb601968b0547c5a6" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.067991 3813 raft_consensus.cc:2468] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:39.069103 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6ccd6add84b428eb601968b0547c5a6" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.069478 3853 leader_election.cc:304] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:39.069764 3738 raft_consensus.cc:2468] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:39.070501 4107 raft_consensus.cc:2804] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.070874 4107 raft_consensus.cc:493] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.070192 3636 catalog_manager.cc:5654] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:39.071193 4107 raft_consensus.cc:3060] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.073149 4010 tablet_bootstrap.cc:654] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.075616 4006 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.078480 4006 ts_tablet_manager.cc:1403] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.013s
I20251215 20:53:39.078994 4007 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:39.080241 4107 raft_consensus.cc:515] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.081348 4007 ts_tablet_manager.cc:1403] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.080s user 0.030s sys 0.018s
I20251215 20:53:39.081110 4006 raft_consensus.cc:359] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.081918 4006 raft_consensus.cc:385] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.082228 4006 raft_consensus.cc:740] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.082928 4006 consensus_queue.cc:260] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.084158 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6ccd6add84b428eb601968b0547c5a6" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:39.085312 3738 raft_consensus.cc:3060] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.086895 4005 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.087339 4005 ts_tablet_manager.cc:1403] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.041s user 0.013s sys 0.006s
I20251215 20:53:39.092388 4005 raft_consensus.cc:359] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.092965 4005 raft_consensus.cc:385] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.093286 3738 raft_consensus.cc:2468] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:39.094436 3851 leader_election.cc:304] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:39.093222 4005 raft_consensus.cc:740] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.095489 4109 raft_consensus.cc:2804] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.095429 4005 consensus_queue.cc:260] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.096055 4109 raft_consensus.cc:697] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:39.096966 4109 consensus_queue.cc:237] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.097497 4005 ts_tablet_manager.cc:1434] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251215 20:53:39.098949 4005 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.103624 4007 raft_consensus.cc:359] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.104323 4007 raft_consensus.cc:385] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.104570 4005 tablet_bootstrap.cc:654] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.106194 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6ccd6add84b428eb601968b0547c5a6" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:39.106815 3813 raft_consensus.cc:3060] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.104604 4007 raft_consensus.cc:740] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.107671 4007 consensus_queue.cc:260] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.110001 4007 ts_tablet_manager.cc:1434] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20251215 20:53:39.110839 4007 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:39.114145 3813 raft_consensus.cc:2468] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:39.094666 4006 ts_tablet_manager.cc:1434] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20251215 20:53:39.116457 4006 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.122601 4007 tablet_bootstrap.cc:654] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.124394 4107 leader_election.cc:290] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.126797 3636 catalog_manager.cc:5654] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:39.127883 4006 tablet_bootstrap.cc:654] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.128017 4010 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:39.128618 4010 ts_tablet_manager.cc:1403] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.094s user 0.024s sys 0.024s
I20251215 20:53:39.130541 4005 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.131073 4005 ts_tablet_manager.cc:1403] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.004s
I20251215 20:53:39.131037 4010 raft_consensus.cc:359] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.132220 4010 raft_consensus.cc:385] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.134013 4010 raft_consensus.cc:740] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.134306 4005 raft_consensus.cc:359] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.134698 4010 consensus_queue.cc:260] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.135466 4005 raft_consensus.cc:385] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.136118 4005 raft_consensus.cc:740] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.137125 4041 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.137677 4041 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.139622 4041 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.141494 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
W20251215 20:53:39.143146 3927 leader_election.cc:343] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.143802 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.144503 4010 ts_tablet_manager.cc:1434] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.016s user 0.005s sys 0.002s
W20251215 20:53:39.145095 3925 leader_election.cc:343] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.145550 3925 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:39.144925 4005 consensus_queue.cc:260] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.147384 4041 raft_consensus.cc:2749] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.149161 4005 ts_tablet_manager.cc:1434] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20251215 20:53:39.151610 4005 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.152032 4010 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:39.154767 4007 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:39.155319 4007 ts_tablet_manager.cc:1403] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.005s
I20251215 20:53:39.156021 4107 raft_consensus.cc:493] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.156497 4107 raft_consensus.cc:515] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.158257 4107 leader_election.cc:290] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:39.158911 4010 tablet_bootstrap.cc:654] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.159933 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6888cc3ab31a4688a8fdda25f79dc586" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.160570 3813 raft_consensus.cc:2468] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:39.161684 3853 leader_election.cc:304] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:39.161703 4103 raft_consensus.cc:493] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.162804 4103 raft_consensus.cc:515] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.158022 4007 raft_consensus.cc:359] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.164650 4103 leader_election.cc:290] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.164664 4007 raft_consensus.cc:385] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.166164 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6888cc3ab31a4688a8fdda25f79dc586" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:39.166630 4007 raft_consensus.cc:740] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.166812 3960 raft_consensus.cc:2468] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:39.166071 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.168262 4107 raft_consensus.cc:2804] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.170980 4107 raft_consensus.cc:493] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.168715 4103 consensus_queue.cc:1048] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:53:39.171183 3703 leader_election.cc:343] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.169128 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.169993 4005 tablet_bootstrap.cc:654] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.171479 4107 raft_consensus.cc:3060] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.171927 4006 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.172441 4006 ts_tablet_manager.cc:1403] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.056s user 0.017s sys 0.019s
I20251215 20:53:39.175247 4006 raft_consensus.cc:359] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
W20251215 20:53:39.175838 3704 leader_election.cc:343] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.176352 3704 leader_election.cc:304] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.177400 4103 raft_consensus.cc:2749] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.175869 4006 raft_consensus.cc:385] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.178356 4006 raft_consensus.cc:740] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.178943 4006 consensus_queue.cc:260] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.179404 4103 raft_consensus.cc:493] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.184222 4109 consensus_queue.cc:1048] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.184942 4107 raft_consensus.cc:515] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.186264 4046 raft_consensus.cc:493] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.186739 4046 raft_consensus.cc:515] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.188536 4046 leader_election.cc:290] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:39.179862 4103 raft_consensus.cc:515] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.190326 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88e0d9134794daab38013d35aadbacd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:39.193301 3703 leader_election.cc:343] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.196617 4099 raft_consensus.cc:493] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.197141 4099 raft_consensus.cc:515] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.199038 4099 leader_election.cc:290] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.202654 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:39.203245 3961 raft_consensus.cc:2468] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:39.204715 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.206004 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88e0d9134794daab38013d35aadbacd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:39.206032 4006 ts_tablet_manager.cc:1434] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.033s user 0.005s sys 0.001s
I20251215 20:53:39.207597 4006 tablet_bootstrap.cc:492] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.208909 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:39.209568 3960 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:39.210668 4099 consensus_queue.cc:1048] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.211676 4086 raft_consensus.cc:493] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.212976 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6888cc3ab31a4688a8fdda25f79dc586" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:39.212146 4086 raft_consensus.cc:515] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.213739 3813 raft_consensus.cc:3060] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:39.214392 3704 leader_election.cc:343] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.215047 4086 leader_election.cc:290] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:39.216845 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.217639 3737 raft_consensus.cc:2393] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:39.218865 4103 leader_election.cc:290] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.219894 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6888cc3ab31a4688a8fdda25f79dc586" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:39.220625 3961 raft_consensus.cc:3060] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.222590 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:39.170691 4007 consensus_queue.cc:260] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.168447 4010 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:39.224107 4010 ts_tablet_manager.cc:1403] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.072s user 0.012s sys 0.002s
I20251215 20:53:39.225250 4007 ts_tablet_manager.cc:1434] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.070s user 0.005s sys 0.000s
I20251215 20:53:39.223809 3779 leader_election.cc:304] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:39.226122 4007 tablet_bootstrap.cc:492] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:39.226486 4086 raft_consensus.cc:3060] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.226672 4010 raft_consensus.cc:359] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.227349 4010 raft_consensus.cc:385] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.227600 4010 raft_consensus.cc:740] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.228188 4010 consensus_queue.cc:260] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.231444 4007 tablet_bootstrap.cc:654] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.215214 3704 leader_election.cc:304] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
W20251215 20:53:39.233363 3704 leader_election.cc:343] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.233660 4010 ts_tablet_manager.cc:1434] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20251215 20:53:39.233865 4103 raft_consensus.cc:2804] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.234251 4103 raft_consensus.cc:493] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.234549 4010 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:39.234844 3704 leader_election.cc:304] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:39.235586 4099 raft_consensus.cc:2749] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.236689 3704 leader_election.cc:304] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.234591 4103 raft_consensus.cc:3060] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.240475 4010 tablet_bootstrap.cc:654] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.243991 4103 raft_consensus.cc:515] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.245842 4103 leader_election.cc:290] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.246358 4099 raft_consensus.cc:2804] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.246739 4099 raft_consensus.cc:493] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.247136 4086 raft_consensus.cc:2749] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.247056 4099 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.251469 4041 consensus_queue.cc:1048] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.255337 4099 raft_consensus.cc:515] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.255818 3960 raft_consensus.cc:3060] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.264252 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.264508 4006 tablet_bootstrap.cc:654] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.264950 3810 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:39.265277 4107 leader_election.cc:290] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:39.267362 3961 raft_consensus.cc:2468] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:39.271940 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:39.273303 3959 raft_consensus.cc:3060] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.272037 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:39.282133 3810 raft_consensus.cc:3060] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.297314 4099 leader_election.cc:290] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.292768 3853 leader_election.cc:304] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.298593 4005 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.299036 4005 ts_tablet_manager.cc:1403] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.148s user 0.028s sys 0.035s
I20251215 20:53:39.301445 4005 raft_consensus.cc:359] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.302021 4005 raft_consensus.cc:385] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.302264 4005 raft_consensus.cc:740] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.302865 4005 consensus_queue.cc:260] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.304875 4005 ts_tablet_manager.cc:1434] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251215 20:53:39.305759 4005 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.308553 4107 raft_consensus.cc:2804] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.309083 4107 raft_consensus.cc:697] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:39.309899 4107 consensus_queue.cc:237] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.311003 4005 tablet_bootstrap.cc:654] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.312103 3810 raft_consensus.cc:2468] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:39.319206 3813 raft_consensus.cc:2468] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:39.323714 4058 consensus_queue.cc:1048] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.324986 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:39.325687 3813 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.317533 3959 raft_consensus.cc:2468] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:39.329149 4043 consensus_queue.cc:1048] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251215 20:53:39.335269 4006 tablet_bootstrap.cc:492] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.335752 4006 ts_tablet_manager.cc:1403] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.128s user 0.042s sys 0.016s
I20251215 20:53:39.336715 3813 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:39.338163 4006 raft_consensus.cc:359] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.338804 4006 raft_consensus.cc:385] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.339085 4006 raft_consensus.cc:740] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.339850 4006 consensus_queue.cc:260] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.342738 4006 ts_tablet_manager.cc:1434] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20251215 20:53:39.343704 4006 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.348526 4016 consensus_queue.cc:1048] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.361810 4006 tablet_bootstrap.cc:654] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.366235 4058 raft_consensus.cc:493] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.366786 4058 raft_consensus.cc:515] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.368774 4058 leader_election.cc:290] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:39.369251 4058 raft_consensus.cc:493] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.369668 4058 raft_consensus.cc:515] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.369853 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:39.370649 3959 raft_consensus.cc:2393] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:39.372359 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.373910 3851 leader_election.cc:304] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:39.374802 4109 raft_consensus.cc:3060] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.375989 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87b34b8adfa44d8680e7f070cad3428c" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:39.376130 4058 leader_election.cc:290] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:39.377977 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87b34b8adfa44d8680e7f070cad3428c" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.378790 3738 raft_consensus.cc:2393] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:39.379956 3851 leader_election.cc:304] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:39.381067 4058 raft_consensus.cc:3060] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.387943 4058 raft_consensus.cc:2749] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.389822 4109 raft_consensus.cc:2749] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.369912 3704 leader_election.cc:304] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:39.393323 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:39.393934 3960 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.395190 4012 consensus_queue.cc:1048] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.397645 4043 raft_consensus.cc:493] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.398100 4043 raft_consensus.cc:515] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.400076 4043 leader_election.cc:290] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.401903 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.402565 3812 raft_consensus.cc:2468] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:39.403717 3927 leader_election.cc:304] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.404986 4043 raft_consensus.cc:2804] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.405169 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.405849 4046 raft_consensus.cc:2804] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.406342 4046 raft_consensus.cc:697] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
W20251215 20:53:39.406906 3926 leader_election.cc:343] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.407171 4046 consensus_queue.cc:237] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.410140 4006 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.412432 4043 raft_consensus.cc:493] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.412853 4043 raft_consensus.cc:3060] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.425912 4006 ts_tablet_manager.cc:1403] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.067s user 0.009s sys 0.000s
I20251215 20:53:39.428529 4006 raft_consensus.cc:359] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.429152 4006 raft_consensus.cc:385] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.429404 4006 raft_consensus.cc:740] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.429980 4006 consensus_queue.cc:260] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.430737 4007 tablet_bootstrap.cc:492] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:39.431190 4007 ts_tablet_manager.cc:1403] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.205s user 0.007s sys 0.002s
I20251215 20:53:39.433952 4007 raft_consensus.cc:359] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.434558 4007 raft_consensus.cc:385] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.434804 4007 raft_consensus.cc:740] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.435456 4007 consensus_queue.cc:260] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.436353 4016 consensus_queue.cc:1048] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.437461 4007 ts_tablet_manager.cc:1434] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20251215 20:53:39.438354 4007 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:39.441231 4006 ts_tablet_manager.cc:1434] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20251215 20:53:39.442181 4006 tablet_bootstrap.cc:492] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.443848 4007 tablet_bootstrap.cc:654] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.445168 3704 leader_election.cc:304] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.445924 4103 raft_consensus.cc:2804] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.446400 4103 raft_consensus.cc:697] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:39.447474 4006 tablet_bootstrap.cc:654] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.447247 4103 consensus_queue.cc:237] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.449278 4005 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.450151 4005 ts_tablet_manager.cc:1403] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.145s user 0.009s sys 0.007s
I20251215 20:53:39.452869 4005 raft_consensus.cc:359] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.457851 4005 raft_consensus.cc:385] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.458150 4005 raft_consensus.cc:740] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.458245 4006 tablet_bootstrap.cc:492] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.458786 4006 ts_tablet_manager.cc:1403] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.005s
I20251215 20:53:39.458922 4005 consensus_queue.cc:260] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.461342 4006 raft_consensus.cc:359] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.461973 4006 raft_consensus.cc:385] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.462162 4005 ts_tablet_manager.cc:1434] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20251215 20:53:39.462292 4006 raft_consensus.cc:740] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.462016 3635 catalog_manager.cc:5654] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:39.463773 4005 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.464015 4006 consensus_queue.cc:260] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.467051 4006 ts_tablet_manager.cc:1434] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:53:39.467505 4007 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:39.467867 4006 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.467952 4007 ts_tablet_manager.cc:1403] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.030s user 0.019s sys 0.002s
I20251215 20:53:39.470518 4007 raft_consensus.cc:359] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.471104 4007 raft_consensus.cc:385] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.471369 4007 raft_consensus.cc:740] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.472015 4007 consensus_queue.cc:260] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.473343 4005 tablet_bootstrap.cc:654] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.474246 4007 ts_tablet_manager.cc:1434] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:53:39.475136 4007 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:39.475728 4006 tablet_bootstrap.cc:654] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.480187 4007 tablet_bootstrap.cc:654] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.485019 4005 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.485791 4005 ts_tablet_manager.cc:1403] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.005s
I20251215 20:53:39.486613 4006 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.487035 4006 ts_tablet_manager.cc:1403] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.002s
I20251215 20:53:39.488256 4005 raft_consensus.cc:359] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.489041 4005 raft_consensus.cc:385] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.489333 4005 raft_consensus.cc:740] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.490072 4005 consensus_queue.cc:260] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.491133 4010 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:39.491586 4010 ts_tablet_manager.cc:1403] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.257s user 0.033s sys 0.049s
I20251215 20:53:39.491978 4005 ts_tablet_manager.cc:1434] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:39.492900 4005 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.493898 4010 raft_consensus.cc:359] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.494527 4010 raft_consensus.cc:385] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.494787 4010 raft_consensus.cc:740] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.495390 4010 consensus_queue.cc:260] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.489341 4006 raft_consensus.cc:359] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.497512 4006 raft_consensus.cc:385] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.497694 4010 ts_tablet_manager.cc:1434] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20251215 20:53:39.497807 4006 raft_consensus.cc:740] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.498589 4006 consensus_queue.cc:260] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.499573 4005 tablet_bootstrap.cc:654] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:39.497387 3704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:42341, user_credentials={real_user=slave}} blocked reactor thread for 52297.4us
I20251215 20:53:39.500847 4006 ts_tablet_manager.cc:1434] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20251215 20:53:39.502035 4012 consensus_queue.cc:1048] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.503646 4006 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.509555 4006 tablet_bootstrap.cc:654] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.510532 4005 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.511041 4005 ts_tablet_manager.cc:1403] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20251215 20:53:39.512049 4010 tablet_bootstrap.cc:492] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:39.513741 4005 raft_consensus.cc:359] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.514498 4005 raft_consensus.cc:385] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.514824 4005 raft_consensus.cc:740] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.515481 4005 consensus_queue.cc:260] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.517805 4005 ts_tablet_manager.cc:1434] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:39.518946 4005 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.519814 4010 tablet_bootstrap.cc:654] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.521015 4011 consensus_queue.cc:1048] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.532109 4099 consensus_queue.cc:1048] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:39.535454 4005 tablet_bootstrap.cc:654] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.523844 4043 raft_consensus.cc:515] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.526881 4006 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.537487 4006 ts_tablet_manager.cc:1403] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.034s user 0.013s sys 0.004s
I20251215 20:53:39.527174 4107 raft_consensus.cc:493] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.539260 4107 raft_consensus.cc:515] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.539594 4041 raft_consensus.cc:493] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.540123 4041 raft_consensus.cc:515] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.541306 4107 leader_election.cc:290] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:39.566174 4006 raft_consensus.cc:359] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.566874 4006 raft_consensus.cc:385] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.567157 4006 raft_consensus.cc:740] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.567761 4041 leader_election.cc:290] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:39.569336 4043 leader_election.cc:290] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.569336 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ac3237768974cdda7de26ef5b8b6740" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.567757 4006 consensus_queue.cc:260] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.576992 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.577694 3811 raft_consensus.cc:2468] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:39.581736 4010 tablet_bootstrap.cc:492] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:39.582255 4010 ts_tablet_manager.cc:1403] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.070s user 0.021s sys 0.008s
I20251215 20:53:39.583088 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ac3237768974cdda7de26ef5b8b6740" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.583797 3735 raft_consensus.cc:2468] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
W20251215 20:53:39.587889 3926 leader_election.cc:343] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.589779 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
W20251215 20:53:39.590178 4168 log.cc:927] Time spent T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20251215 20:53:39.590528 3959 raft_consensus.cc:2393] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:39.590679 3853 leader_election.cc:304] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:39.591619 4107 raft_consensus.cc:2804] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.591988 4107 raft_consensus.cc:493] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.592331 4107 raft_consensus.cc:3060] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.598644 4006 ts_tablet_manager.cc:1434] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.061s user 0.005s sys 0.001s
I20251215 20:53:39.600699 4006 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.599290 4043 raft_consensus.cc:493] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.603296 4005 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.603199 4043 raft_consensus.cc:515] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.607491 4005 ts_tablet_manager.cc:1403] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.089s user 0.007s sys 0.007s
I20251215 20:53:39.608590 4043 leader_election.cc:290] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.609483 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:39.610428 4099 consensus_queue.cc:1048] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.611562 3925 leader_election.cc:304] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.612866 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.611706 4005 raft_consensus.cc:359] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.613895 4005 raft_consensus.cc:385] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.614491 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:39.617161 3811 raft_consensus.cc:3060] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.610333 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.618336 3886 raft_consensus.cc:2468] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:39.616504 4006 tablet_bootstrap.cc:654] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.619483 3926 leader_election.cc:304] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.620434 4128 raft_consensus.cc:2804] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:39.620803 4128 raft_consensus.cc:493] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.621114 4128 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:39.623204 4005 raft_consensus.cc:740] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.624006 4005 consensus_queue.cc:260] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.614285 4043 raft_consensus.cc:2804] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.625448 4043 raft_consensus.cc:493] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.625809 4043 raft_consensus.cc:3060] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.626363 4005 ts_tablet_manager.cc:1434] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20251215 20:53:39.602365 3960 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:39.613483 3735 raft_consensus.cc:2468] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:39.610448 3634 catalog_manager.cc:5654] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:39.629088 4005 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.629619 3634 catalog_manager.cc:5654] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:39.628222 4107 raft_consensus.cc:515] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.644622 3885 raft_consensus.cc:2393] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 1: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:39.650976 4046 consensus_queue.cc:1048] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.657546 4058 consensus_queue.cc:1048] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.672998 4012 raft_consensus.cc:493] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.673593 4012 raft_consensus.cc:515] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.674101 4006 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.674676 4006 ts_tablet_manager.cc:1403] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.074s user 0.008s sys 0.008s
I20251215 20:53:39.675598 4012 leader_election.cc:290] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.676564 4165 consensus_queue.cc:1048] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:39.677615 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.678228 3735 raft_consensus.cc:2468] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:39.679251 3925 leader_election.cc:304] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.680585 4012 raft_consensus.cc:2804] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.682104 4012 raft_consensus.cc:493] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.682524 4012 raft_consensus.cc:3060] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.682890 4006 raft_consensus.cc:359] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.683624 4006 raft_consensus.cc:385] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.683907 4006 raft_consensus.cc:740] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.681288 4007 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:39.688176 4007 ts_tablet_manager.cc:1403] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.213s user 0.034s sys 0.083s
I20251215 20:53:39.684857 4006 consensus_queue.cc:260] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.689280 3811 raft_consensus.cc:2468] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:39.676678 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
W20251215 20:53:39.690820 3927 leader_election.cc:343] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.691293 4006 ts_tablet_manager.cc:1434] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20251215 20:53:39.686684 4128 raft_consensus.cc:515] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.691767 3927 leader_election.cc:304] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.692703 4041 raft_consensus.cc:2804] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.694176 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:39.694743 3738 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:39.695456 4005 tablet_bootstrap.cc:654] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.699800 4128 leader_election.cc:290] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.700515 4128 raft_consensus.cc:493] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.700942 4128 raft_consensus.cc:515] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.701929 4107 leader_election.cc:290] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:39.701133 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:39.702527 3887 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:39.702677 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:39.710299 3811 raft_consensus.cc:2393] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:39.703810 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88e0d9134794daab38013d35aadbacd" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.704063 4043 raft_consensus.cc:515] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.705361 3738 raft_consensus.cc:2468] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:39.706938 4128 leader_election.cc:290] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:39.703712 4006 tablet_bootstrap.cc:492] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.730923 4007 raft_consensus.cc:359] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.731890 4007 raft_consensus.cc:385] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.732277 4007 raft_consensus.cc:740] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.740785 4007 consensus_queue.cc:260] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.749784 4010 raft_consensus.cc:359] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.750494 4010 raft_consensus.cc:385] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.750754 4010 raft_consensus.cc:740] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.753029 4007 ts_tablet_manager.cc:1434] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.064s user 0.006s sys 0.000s
I20251215 20:53:39.754114 4007 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:39.752658 4010 consensus_queue.cc:260] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.759215 4012 raft_consensus.cc:515] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.760946 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88e0d9134794daab38013d35aadbacd" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.761555 3738 raft_consensus.cc:2468] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:39.763635 3925 leader_election.cc:304] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.764463 4190 raft_consensus.cc:2804] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:39.764909 4190 raft_consensus.cc:697] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:39.747650 4128 raft_consensus.cc:493] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.765398 4128 raft_consensus.cc:515] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.765710 4190 consensus_queue.cc:237] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.767400 4128 leader_election.cc:290] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:39.754729 4041 raft_consensus.cc:697] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:39.773208 4010 ts_tablet_manager.cc:1434] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.191s user 0.005s sys 0.003s
I20251215 20:53:39.776597 4010 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:39.777441 4006 tablet_bootstrap.cc:654] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.774437 4099 raft_consensus.cc:493] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.781473 4099 raft_consensus.cc:515] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.783380 4099 leader_election.cc:290] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.784128 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b792f698514fcf976075ab99eda917" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.784961 4043 leader_election.cc:290] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
W20251215 20:53:39.785766 3704 leader_election.cc:343] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.786389 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b792f698514fcf976075ab99eda917" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.798835 4007 tablet_bootstrap.cc:654] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:39.799140 3684 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20251215 20:53:39.802891 3703 leader_election.cc:343] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.803365 3703 leader_election.cc:304] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.804957 4099 raft_consensus.cc:2749] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:53:39.806114 4184 log.cc:927] Time spent T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185: Append to log took a long time: real 0.060s user 0.000s sys 0.001s
I20251215 20:53:39.808064 4012 leader_election.cc:290] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.791354 3925 leader_election.cc:304] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.809614 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
W20251215 20:53:39.810637 3926 leader_election.cc:343] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.811875 3853 leader_election.cc:304] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:39.813087 4109 raft_consensus.cc:2749] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.813397 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ac3237768974cdda7de26ef5b8b6740" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:39.813786 4128 raft_consensus.cc:2804] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.813983 3737 raft_consensus.cc:3060] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.815852 4165 consensus_queue.cc:1048] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.816538 4128 raft_consensus.cc:493] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.816923 4128 raft_consensus.cc:3060] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.817435 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.819375 4043 raft_consensus.cc:493] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.819608 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.820333 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:39.819896 4043 raft_consensus.cc:515] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.821998 3737 raft_consensus.cc:2468] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
W20251215 20:53:39.822468 3927 leader_election.cc:343] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.824613 4043 leader_election.cc:290] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.816941 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ac3237768974cdda7de26ef5b8b6740" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:39.825074 3926 leader_election.cc:343] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.825873 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.829123 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.814054 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:39.839219 3736 raft_consensus.cc:3060] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:39.839781 3925 leader_election.cc:343] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.840323 3925 leader_election.cc:304] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.773275 4041 consensus_queue.cc:237] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.847922 4191 raft_consensus.cc:2749] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:53:39.849004 3927 leader_election.cc:343] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.849740 3925 leader_election.cc:304] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
W20251215 20:53:39.850615 3925 leader_election.cc:343] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.851032 3925 leader_election.cc:304] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:39.834308 4043 raft_consensus.cc:493] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.853124 4010 tablet_bootstrap.cc:654] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.854099 4190 raft_consensus.cc:2804] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.855116 4107 consensus_queue.cc:1048] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.855947 4005 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:39.856540 4005 ts_tablet_manager.cc:1403] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.228s user 0.014s sys 0.003s
I20251215 20:53:39.856652 3887 raft_consensus.cc:2468] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:39.857491 4099 consensus_queue.cc:1048] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.857813 4012 raft_consensus.cc:2749] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.843300 4189 raft_consensus.cc:493] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.858642 4189 raft_consensus.cc:515] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.861073 4005 raft_consensus.cc:359] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.861747 4005 raft_consensus.cc:385] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.861945 4005 raft_consensus.cc:740] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.862453 4005 consensus_queue.cc:260] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.853616 4043 raft_consensus.cc:515] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.860747 4189 leader_election.cc:290] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.866112 4006 tablet_bootstrap.cc:492] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:39.866516 4006 ts_tablet_manager.cc:1403] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.163s user 0.017s sys 0.012s
I20251215 20:53:39.854614 4190 raft_consensus.cc:697] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
W20251215 20:53:39.867249 3926 leader_election.cc:343] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.872687 4007 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:39.873262 4007 ts_tablet_manager.cc:1403] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.119s user 0.021s sys 0.010s
I20251215 20:53:39.873047 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbcea7686fdf4ece84af2fb29ea12a48" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:39.874675 3926 leader_election.cc:343] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.875716 4007 raft_consensus.cc:359] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.879561 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbcea7686fdf4ece84af2fb29ea12a48" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.879877 4007 raft_consensus.cc:385] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.880162 3810 raft_consensus.cc:2468] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:39.880219 4007 raft_consensus.cc:740] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.881108 4007 consensus_queue.cc:260] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.883491 4005 ts_tablet_manager.cc:1434] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20251215 20:53:39.884416 4005 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:39.890223 4007 ts_tablet_manager.cc:1434] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20251215 20:53:39.882452 3736 raft_consensus.cc:2468] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:39.891597 4007 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:39.888424 4165 raft_consensus.cc:493] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.892346 4086 raft_consensus.cc:493] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.889484 3927 leader_election.cc:304] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.896544 4165 raft_consensus.cc:515] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.901374 4190 consensus_queue.cc:237] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.906651 4191 raft_consensus.cc:2804] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.909996 4191 raft_consensus.cc:493] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.910319 4191 raft_consensus.cc:3060] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.900534 4086 raft_consensus.cc:515] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:39.904668 3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 53386.9us
I20251215 20:53:39.914124 4165 leader_election.cc:290] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.914811 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.917744 4086 leader_election.cc:290] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.918771 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.904517 4128 raft_consensus.cc:515] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.921666 3887 raft_consensus.cc:2468] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:39.920713 3736 raft_consensus.cc:2468] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:39.922519 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:39.923167 3735 raft_consensus.cc:2468] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:39.923605 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc6542088b34e38ae967eb065f6bd1f" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.924429 4046 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.924889 4046 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.925817 4191 raft_consensus.cc:515] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
W20251215 20:53:39.925134 3927 leader_election.cc:343] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.926679 4046 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:39.927917 4191 leader_election.cc:290] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.929351 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.919955 4043 leader_election.cc:290] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.937465 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbcea7686fdf4ece84af2fb29ea12a48" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:39.938022 3812 raft_consensus.cc:3060] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.938352 4007 tablet_bootstrap.cc:654] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.929786 3851 leader_election.cc:304] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:39.940670 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88e0d9134794daab38013d35aadbacd" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:39.941186 3885 raft_consensus.cc:3060] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.941871 4006 raft_consensus.cc:359] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.942502 4006 raft_consensus.cc:385] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:39.942766 4006 raft_consensus.cc:740] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:39.943392 4006 consensus_queue.cc:260] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:39.930040 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc6542088b34e38ae967eb065f6bd1f" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:39.930461 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.931226 4099 raft_consensus.cc:493] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.931840 3778 leader_election.cc:304] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:39.944818 3811 raft_consensus.cc:2468] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
W20251215 20:53:39.945600 3704 leader_election.cc:343] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:39.946677 3926 leader_election.cc:343] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.947124 3926 leader_election.cc:304] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.947438 4046 consensus_queue.cc:1048] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.947808 4099 raft_consensus.cc:515] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:39.950088 4099 leader_election.cc:290] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:39.950116 4040 raft_consensus.cc:2804] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.950366 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467dc89c982a488b8a405d00a9f39247" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:39.950650 4040 raft_consensus.cc:493] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.950922 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbcea7686fdf4ece84af2fb29ea12a48" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:39.951541 3704 leader_election.cc:343] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.932608 4178 consensus_queue.cc:1048] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:39.933218 4005 tablet_bootstrap.cc:654] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:39.933375 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
W20251215 20:53:39.953039 3926 leader_election.cc:343] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.953253 3959 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:39.933705 3925 leader_election.cc:304] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:39.953797 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467dc89c982a488b8a405d00a9f39247" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:39.954886 3703 leader_election.cc:343] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:39.951054 4040 raft_consensus.cc:3060] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.955283 3703 leader_election.cc:304] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.955502 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88e0d9134794daab38013d35aadbacd" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:39.956053 3735 raft_consensus.cc:3060] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.956462 4165 raft_consensus.cc:2804] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.956833 4165 raft_consensus.cc:493] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.957171 4165 raft_consensus.cc:3060] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.958833 4178 raft_consensus.cc:2749] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.959579 4043 raft_consensus.cc:2749] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:39.961128 4043 raft_consensus.cc:2804] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.961460 3812 raft_consensus.cc:2468] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:39.964722 3735 raft_consensus.cc:2468] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:39.932063 4128 leader_election.cc:290] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:39.966907 3925 leader_election.cc:304] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:39.967139 3704 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:39.966791 4006 ts_tablet_manager.cc:1434] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.100s user 0.000s sys 0.006s
I20251215 20:53:39.968987 4006 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:39.969807 4178 raft_consensus.cc:2804] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:39.970194 4178 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:39.970507 4178 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:39.984243 4043 raft_consensus.cc:697] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:39.985227 4043 consensus_queue.cc:237] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:39.988134 3885 raft_consensus.cc:2468] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:39.988752 3927 leader_election.cc:304] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:39.991442 4199 raft_consensus.cc:2804] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.991958 4199 raft_consensus.cc:697] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:39.992775 4199 consensus_queue.cc:237] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.995684 4128 raft_consensus.cc:2804] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:39.996188 4128 raft_consensus.cc:697] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:39.996421 4099 raft_consensus.cc:493] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:39.996914 4099 raft_consensus.cc:515] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:39.999591 4099 leader_election.cc:290] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:40.004791 4040 raft_consensus.cc:515] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.006661 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:40.010685 3703 leader_election.cc:343] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.011451 4006 tablet_bootstrap.cc:654] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.028152 4010 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:40.028766 4010 ts_tablet_manager.cc:1403] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.252s user 0.010s sys 0.004s
I20251215 20:53:40.021078 4058 raft_consensus.cc:493] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.030840 4058 raft_consensus.cc:515] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.031536 4010 raft_consensus.cc:359] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.032235 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:40.032457 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.035655 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ac3237768974cdda7de26ef5b8b6740" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.036106 3959 raft_consensus.cc:2468] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:40.033403 4058 leader_election.cc:290] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:40.038633 3735 raft_consensus.cc:3060] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.039563 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ac3237768974cdda7de26ef5b8b6740" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:40.040323 3736 raft_consensus.cc:2393] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:40.032748 4128 consensus_queue.cc:237] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.042922 4011 consensus_queue.cc:1048] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.043278 4005 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.043772 4005 ts_tablet_manager.cc:1403] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.160s user 0.020s sys 0.004s
I20251215 20:53:40.043653 3851 leader_election.cc:304] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:40.044852 4058 raft_consensus.cc:3060] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.033582 4165 raft_consensus.cc:515] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.018613 4040 leader_election.cc:290] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:40.046260 4010 raft_consensus.cc:385] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.046232 4005 raft_consensus.cc:359] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.051581 4010 raft_consensus.cc:740] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.051884 4005 raft_consensus.cc:385] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.052237 4005 raft_consensus.cc:740] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.053397 4005 consensus_queue.cc:260] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.052670 4010 consensus_queue.cc:260] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.052248 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:40.063287 4010 ts_tablet_manager.cc:1434] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20251215 20:53:40.064193 4010 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:40.068352 4005 ts_tablet_manager.cc:1434] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20251215 20:53:40.071496 4005 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.069300 3704 leader_election.cc:304] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.078212 4046 raft_consensus.cc:2804] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.078572 4046 raft_consensus.cc:493] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.078876 4046 raft_consensus.cc:3060] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.079083 4005 tablet_bootstrap.cc:654] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.085675 4046 raft_consensus.cc:515] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.086798 4165 leader_election.cc:290] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.087289 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:40.090792 3811 raft_consensus.cc:2393] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:40.091605 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a9f02af02424808a0612e7caa798ebb" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:40.090309 4007 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:40.093258 4007 ts_tablet_manager.cc:1403] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.202s user 0.029s sys 0.014s
I20251215 20:53:40.072443 3885 raft_consensus.cc:2393] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:40.097445 3851 leader_election.cc:304] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:40.099149 4046 leader_election.cc:290] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:40.100369 4165 raft_consensus.cc:2749] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.100872 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:40.101109 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:40.101467 3961 raft_consensus.cc:3060] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:40.102205 3703 leader_election.cc:343] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.104693 3635 catalog_manager.cc:5654] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:40.104265 4040 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.107709 4040 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.109553 4040 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:40.111883 3961 raft_consensus.cc:2468] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:40.113431 3704 leader_election.cc:304] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.115131 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.072192 4178 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.115816 3961 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:40.116963 4011 raft_consensus.cc:2804] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.117239 4178 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.117527 4011 raft_consensus.cc:697] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:40.118330 4011 consensus_queue.cc:237] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.118587 3779 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:40.119136 4058 raft_consensus.cc:2749] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.117347 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:40.119994 4040 raft_consensus.cc:2804] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.120177 3736 raft_consensus.cc:2393] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:40.120473 4040 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.120851 4040 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.126370 4007 raft_consensus.cc:359] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.127079 4007 raft_consensus.cc:385] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.127343 4007 raft_consensus.cc:740] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.132385 4006 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:40.132826 4006 ts_tablet_manager.cc:1403] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.164s user 0.013s sys 0.009s
I20251215 20:53:40.132666 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:40.134655 4007 consensus_queue.cc:260] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.124111 3735 raft_consensus.cc:2468] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:40.137046 4007 ts_tablet_manager.cc:1434] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.043s user 0.004s sys 0.002s
I20251215 20:53:40.167474 4007 tablet_bootstrap.cc:492] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:40.167301 3777 leader_election.cc:304] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.137344 4005 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.134357 3961 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.169667 4005 ts_tablet_manager.cc:1403] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.101s user 0.017s sys 0.008s
I20251215 20:53:40.139984 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:40.168555 4016 raft_consensus.cc:2804] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.172470 4016 raft_consensus.cc:697] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:40.158331 3636 catalog_manager.cc:5654] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:40.173305 4007 tablet_bootstrap.cc:654] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.173547 4016 consensus_queue.cc:237] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.174826 4043 raft_consensus.cc:493] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.175276 4043 raft_consensus.cc:515] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.178355 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6371592021d429ba136b0ef52728bbb" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:40.179683 3926 leader_election.cc:343] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.180233 4043 leader_election.cc:290] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:40.182073 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6371592021d429ba136b0ef52728bbb" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
W20251215 20:53:40.183554 3927 leader_election.cc:343] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.141400 4006 raft_consensus.cc:359] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.184008 3927 leader_election.cc:304] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.184425 4006 raft_consensus.cc:385] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.184746 4006 raft_consensus.cc:740] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.185179 4007 tablet_bootstrap.cc:492] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:40.185722 4007 ts_tablet_manager.cc:1403] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.003s
I20251215 20:53:40.185412 4006 consensus_queue.cc:260] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.185959 4043 raft_consensus.cc:2749] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.187251 4006 ts_tablet_manager.cc:1434] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
I20251215 20:53:40.172242 4005 raft_consensus.cc:359] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.188076 4007 raft_consensus.cc:359] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.190827 4005 raft_consensus.cc:385] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.190893 4007 raft_consensus.cc:385] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.191280 4005 raft_consensus.cc:740] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.191308 4007 raft_consensus.cc:740] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.188126 4006 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:40.192204 4005 consensus_queue.cc:260] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.192767 4007 consensus_queue.cc:260] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.194970 4005 ts_tablet_manager.cc:1434] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
I20251215 20:53:40.196112 4005 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.198472 4007 ts_tablet_manager.cc:1434] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20251215 20:53:40.199394 4007 tablet_bootstrap.cc:492] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:40.198525 4043 raft_consensus.cc:493] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.199913 4043 raft_consensus.cc:515] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.201792 4043 leader_election.cc:290] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:40.203794 4010 tablet_bootstrap.cc:654] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.203671 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:40.204969 3926 leader_election.cc:343] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.205085 4007 tablet_bootstrap.cc:654] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.134790 4040 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.207087 3961 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:40.214491 3813 raft_consensus.cc:2393] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 230b971d5efa4b3aa8d8f05fc3a3faec in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:40.214851 3704 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:40.216190 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:40.216661 4011 raft_consensus.cc:2804] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.217123 4011 raft_consensus.cc:697] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
W20251215 20:53:40.217605 3925 leader_election.cc:343] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.218122 3925 leader_election.cc:304] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.217898 4011 consensus_queue.cc:237] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.219204 4043 raft_consensus.cc:2749] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.219852 3635 catalog_manager.cc:5654] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:40.225319 4005 tablet_bootstrap.cc:654] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.225355 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:40.225603 4040 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:40.226183 3961 raft_consensus.cc:2393] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:40.222970 3635 catalog_manager.cc:5654] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 2, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:40.227799 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:40.229934 3779 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:40.230763 4040 raft_consensus.cc:2749] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.232838 4006 tablet_bootstrap.cc:654] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.227726 3635 catalog_manager.cc:5654] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:40.236861 4005 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.237385 4005 ts_tablet_manager.cc:1403] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.041s user 0.013s sys 0.004s
I20251215 20:53:40.236218 3635 catalog_manager.cc:5654] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:40.238771 3635 catalog_manager.cc:5654] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:40.240104 4005 raft_consensus.cc:359] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.240816 4005 raft_consensus.cc:385] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.241103 4005 raft_consensus.cc:740] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.241907 4005 consensus_queue.cc:260] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.244205 4010 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:40.244690 4010 ts_tablet_manager.cc:1403] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.181s user 0.018s sys 0.004s
I20251215 20:53:40.246958 4010 raft_consensus.cc:359] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.247465 4005 ts_tablet_manager.cc:1434] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20251215 20:53:40.247579 4010 raft_consensus.cc:385] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.248035 4010 raft_consensus.cc:740] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.248677 4005 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.248757 4010 consensus_queue.cc:260] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.250990 4010 ts_tablet_manager.cc:1434] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:40.251823 4010 tablet_bootstrap.cc:492] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:40.254773 4005 tablet_bootstrap.cc:654] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.258149 3636 catalog_manager.cc:5654] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:40.269054 3633 catalog_manager.cc:5654] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:40.271219 4010 tablet_bootstrap.cc:654] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.284858 3885 raft_consensus.cc:1275] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 20:53:40.287454 4005 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.289520 4005 ts_tablet_manager.cc:1403] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.041s user 0.019s sys 0.013s
I20251215 20:53:40.292537 4005 raft_consensus.cc:359] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.293311 4005 raft_consensus.cc:385] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.293629 4005 raft_consensus.cc:740] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.294463 4043 consensus_queue.cc:1048] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.295392 4005 consensus_queue.cc:260] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.307337 4005 ts_tablet_manager.cc:1434] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20251215 20:53:40.308449 4043 consensus_queue.cc:1048] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.316793 4005 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.322839 4005 tablet_bootstrap.cc:654] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.326707 4191 consensus_queue.cc:1048] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.334793 4005 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.335366 4005 ts_tablet_manager.cc:1403] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
I20251215 20:53:40.344074 4005 raft_consensus.cc:359] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.346112 4005 raft_consensus.cc:385] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.346460 4005 raft_consensus.cc:740] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.347276 4005 consensus_queue.cc:260] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.351668 3735 raft_consensus.cc:1275] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 20:53:40.353536 4191 consensus_queue.cc:1048] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.359478 4043 consensus_queue.cc:1048] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.370651 4190 consensus_queue.cc:1048] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.372210 4005 ts_tablet_manager.cc:1434] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.037s user 0.007s sys 0.000s
I20251215 20:53:40.373250 4005 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.385632 4005 tablet_bootstrap.cc:654] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.390370 4191 consensus_queue.cc:1048] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.398171 4005 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.398747 4005 ts_tablet_manager.cc:1403] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.006s
I20251215 20:53:40.401328 4005 raft_consensus.cc:359] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.404580 4005 raft_consensus.cc:385] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.404718 4178 raft_consensus.cc:493] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.405303 4178 raft_consensus.cc:515] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.405937 4005 raft_consensus.cc:740] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.406690 4005 consensus_queue.cc:260] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.407142 4178 leader_election.cc:290] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:40.408538 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "820e3cc7d81046f1b3436c369048939e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.409348 4005 ts_tablet_manager.cc:1434] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
W20251215 20:53:40.409713 3704 leader_election.cc:343] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.410511 4005 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.410583 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "820e3cc7d81046f1b3436c369048939e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:40.412154 4199 consensus_queue.cc:1048] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:53:40.413998 3703 leader_election.cc:343] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.414429 3703 leader_election.cc:304] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.415150 4011 raft_consensus.cc:2749] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.417358 4005 tablet_bootstrap.cc:654] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.436589 4005 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.437197 4005 ts_tablet_manager.cc:1403] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.027s user 0.018s sys 0.000s
I20251215 20:53:40.439460 4007 tablet_bootstrap.cc:492] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:40.439940 4007 ts_tablet_manager.cc:1403] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.241s user 0.070s sys 0.093s
I20251215 20:53:40.440327 4005 raft_consensus.cc:359] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.441187 4005 raft_consensus.cc:385] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.441504 4005 raft_consensus.cc:740] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.441603 4058 raft_consensus.cc:493] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.442126 4058 raft_consensus.cc:515] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.442329 4005 consensus_queue.cc:260] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.445111 4005 ts_tablet_manager.cc:1434] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:53:40.445791 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b792f698514fcf976075ab99eda917" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:40.446106 4005 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.446817 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b792f698514fcf976075ab99eda917" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.447423 3813 raft_consensus.cc:2468] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:40.446372 3736 raft_consensus.cc:2468] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
W20251215 20:53:40.448659 3927 consensus_peers.cc:597] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:40.448917 4058 leader_election.cc:290] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.449345 3853 leader_election.cc:304] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:40.450160 4058 raft_consensus.cc:2804] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.450523 4058 raft_consensus.cc:493] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.450834 4058 raft_consensus.cc:3060] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.452845 4005 tablet_bootstrap.cc:654] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.457432 4058 raft_consensus.cc:515] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.460251 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b792f698514fcf976075ab99eda917" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:40.460836 3813 raft_consensus.cc:3060] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.464865 4058 leader_election.cc:290] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.489302 4006 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:40.489874 4006 ts_tablet_manager.cc:1403] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.302s user 0.012s sys 0.000s
I20251215 20:53:40.491782 4005 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.492413 4005 ts_tablet_manager.cc:1403] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.046s user 0.015s sys 0.005s
I20251215 20:53:40.492949 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b792f698514fcf976075ab99eda917" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:40.493613 3736 raft_consensus.cc:3060] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.493793 3813 raft_consensus.cc:2468] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:40.497658 4011 raft_consensus.cc:493] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.497746 3853 leader_election.cc:304] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:40.496142 4005 raft_consensus.cc:359] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.498167 4011 raft_consensus.cc:515] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.500335 4011 leader_election.cc:290] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.502180 4058 raft_consensus.cc:2804] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.502264 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.502770 4058 raft_consensus.cc:697] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:40.502934 3961 raft_consensus.cc:2468] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:40.503618 4058 consensus_queue.cc:237] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.505715 4178 raft_consensus.cc:493] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.506217 4178 raft_consensus.cc:515] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.508026 4178 leader_election.cc:290] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.504078 3704 leader_election.cc:304] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:40.511405 4099 raft_consensus.cc:2804] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.500821 3736 raft_consensus.cc:2468] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:40.504714 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.511724 4099 raft_consensus.cc:493] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.511931 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.505141 4005 raft_consensus.cc:385] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.512936 4005 raft_consensus.cc:740] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.513270 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.513576 4005 consensus_queue.cc:260] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.514081 4010 tablet_bootstrap.cc:492] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:40.514568 4010 ts_tablet_manager.cc:1403] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.263s user 0.049s sys 0.123s
I20251215 20:53:40.514740 4006 raft_consensus.cc:359] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.515372 4006 raft_consensus.cc:385] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.512137 4099 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.515625 4006 raft_consensus.cc:740] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
W20251215 20:53:40.518430 3704 leader_election.cc:343] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.520398 4005 ts_tablet_manager.cc:1434] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20251215 20:53:40.521291 4005 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.522073 4099 raft_consensus.cc:515] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.526412 4005 tablet_bootstrap.cc:654] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.518760 4006 consensus_queue.cc:260] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.528664 4010 raft_consensus.cc:359] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.529311 4010 raft_consensus.cc:385] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.529596 4010 raft_consensus.cc:740] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.529428 4007 raft_consensus.cc:359] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.530181 4010 consensus_queue.cc:260] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.530603 4007 raft_consensus.cc:385] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.530982 4007 raft_consensus.cc:740] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.531729 4007 consensus_queue.cc:260] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.537919 4007 ts_tablet_manager.cc:1434] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.098s user 0.006s sys 0.009s
I20251215 20:53:40.538220 4006 ts_tablet_manager.cc:1434] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.048s user 0.008s sys 0.000s
I20251215 20:53:40.538874 4007 tablet_bootstrap.cc:492] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:40.539072 4006 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:40.537859 4010 ts_tablet_manager.cc:1434] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20251215 20:53:40.540376 4010 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:40.541697 4099 leader_election.cc:290] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
W20251215 20:53:40.539573 3704 leader_election.cc:343] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:40.544224 3704 leader_election.cc:343] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.545778 3704 leader_election.cc:304] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:40.546456 4011 raft_consensus.cc:2749] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.546929 3633 catalog_manager.cc:5654] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:40.547843 4007 tablet_bootstrap.cc:654] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.547948 4010 tablet_bootstrap.cc:654] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.551600 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:40.552184 3961 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.559708 3961 raft_consensus.cc:2468] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:40.559950 4011 raft_consensus.cc:493] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.564476 4011 raft_consensus.cc:515] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.565636 4010 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:40.566097 4010 ts_tablet_manager.cc:1403] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.003s
I20251215 20:53:40.566336 4011 leader_election.cc:290] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:40.564919 3704 leader_election.cc:304] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:40.561689 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:40.567726 4099 raft_consensus.cc:2804] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.568217 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92aa097b972542fe997003b6178e7e41" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.559626 4007 tablet_bootstrap.cc:492] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:40.569305 4007 ts_tablet_manager.cc:1403] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.003s
I20251215 20:53:40.563843 4043 consensus_queue.cc:1048] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.568178 4099 raft_consensus.cc:697] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:40.572731 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92aa097b972542fe997003b6178e7e41" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:40.572511 4099 consensus_queue.cc:237] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.576434 4007 raft_consensus.cc:359] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.577091 4007 raft_consensus.cc:385] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.577346 4007 raft_consensus.cc:740] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.577922 4007 consensus_queue.cc:260] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
W20251215 20:53:40.579932 3703 leader_election.cc:343] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.580564 4010 raft_consensus.cc:359] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.580910 4058 raft_consensus.cc:493] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.581167 4010 raft_consensus.cc:385] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.581457 4010 raft_consensus.cc:740] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.581420 4058 raft_consensus.cc:515] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.582262 4010 consensus_queue.cc:260] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.579880 4007 ts_tablet_manager.cc:1434] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20251215 20:53:40.583319 4058 leader_election.cc:290] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:40.584065 4007 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:40.584671 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbcea7686fdf4ece84af2fb29ea12a48" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.585434 3810 raft_consensus.cc:2393] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:40.586326 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbcea7686fdf4ece84af2fb29ea12a48" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
W20251215 20:53:40.582597 3704 leader_election.cc:343] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.587885 3853 leader_election.cc:304] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:40.588338 3704 leader_election.cc:304] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:40.589023 4058 raft_consensus.cc:3060] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:40.589412 3704 leader_election.cc:343] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.589716 4007 tablet_bootstrap.cc:654] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.590803 4103 raft_consensus.cc:2749] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.592029 4010 ts_tablet_manager.cc:1434] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20251215 20:53:40.592958 4010 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:40.594599 4006 tablet_bootstrap.cc:654] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.598204 4010 tablet_bootstrap.cc:654] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.602880 4099 consensus_queue.cc:1048] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.610983 4011 raft_consensus.cc:493] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.611521 4011 raft_consensus.cc:515] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.612413 4040 raft_consensus.cc:493] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.612915 4040 raft_consensus.cc:515] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.614670 4040 leader_election.cc:290] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:40.617416 4011 leader_election.cc:290] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:40.610793 4058 raft_consensus.cc:2749] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.619415 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc6542088b34e38ae967eb065f6bd1f" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.621322 4007 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:40.621870 4007 ts_tablet_manager.cc:1403] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.038s user 0.016s sys 0.002s
I20251215 20:53:40.621927 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc6542088b34e38ae967eb065f6bd1f" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:40.622619 3884 raft_consensus.cc:2468] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:40.624430 4007 raft_consensus.cc:359] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.624660 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:40.625205 4007 raft_consensus.cc:385] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.625504 4007 raft_consensus.cc:740] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.621230 3961 raft_consensus.cc:2468] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:40.626116 4007 consensus_queue.cc:260] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.628439 4007 ts_tablet_manager.cc:1434] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:53:40.629339 4007 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:40.637552 3960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.638144 3960 raft_consensus.cc:2468] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:40.638993 4007 tablet_bootstrap.cc:654] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.643457 3779 leader_election.cc:304] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:40.643862 4005 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.644371 4005 ts_tablet_manager.cc:1403] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.123s user 0.008s sys 0.006s
I20251215 20:53:40.644438 4040 raft_consensus.cc:2804] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.644899 4040 raft_consensus.cc:493] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.645226 4040 raft_consensus.cc:3060] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:40.646656 3703 leader_election.cc:343] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.646828 4005 raft_consensus.cc:359] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.647447 4005 raft_consensus.cc:385] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 20:53:40.647652 3703 consensus_peers.cc:597] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:40.650207 4199 consensus_queue.cc:1048] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.650745 4010 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:40.651197 4010 ts_tablet_manager.cc:1403] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.058s user 0.018s sys 0.008s
I20251215 20:53:40.653725 4010 raft_consensus.cc:359] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.656356 4010 raft_consensus.cc:385] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.656687 4010 raft_consensus.cc:740] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.647696 4005 raft_consensus.cc:740] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.656039 4007 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:40.658043 4007 ts_tablet_manager.cc:1403] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.000s
I20251215 20:53:40.657645 4005 consensus_queue.cc:260] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.658902 3704 leader_election.cc:304] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.660499 4005 ts_tablet_manager.cc:1434] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20251215 20:53:40.657382 4010 consensus_queue.cc:260] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.660471 4199 consensus_queue.cc:1048] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:40.661654 4005 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.661904 4011 raft_consensus.cc:2804] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.662268 4011 raft_consensus.cc:493] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.662590 4011 raft_consensus.cc:3060] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.667122 4040 raft_consensus.cc:515] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.671973 4006 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:40.649212 3633 catalog_manager.cc:5654] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:40.672448 4006 ts_tablet_manager.cc:1403] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.134s user 0.012s sys 0.000s
I20251215 20:53:40.674101 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc6542088b34e38ae967eb065f6bd1f" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:40.674670 3884 raft_consensus.cc:3060] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.669020 4011 raft_consensus.cc:515] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.660547 4007 raft_consensus.cc:359] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.676455 4007 raft_consensus.cc:385] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.676733 4007 raft_consensus.cc:740] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.677366 4007 consensus_queue.cc:260] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.678874 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:40.679416 4007 ts_tablet_manager.cc:1434] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
W20251215 20:53:40.680197 3703 leader_election.cc:343] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.674463 4099 consensus_queue.cc:1048] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.673207 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc6542088b34e38ae967eb065f6bd1f" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:40.681891 3961 raft_consensus.cc:3060] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.682957 4006 raft_consensus.cc:359] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.683627 4006 raft_consensus.cc:385] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.683878 4006 raft_consensus.cc:740] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.684415 4007 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:40.685678 4010 ts_tablet_manager.cc:1434] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20251215 20:53:40.685904 4016 consensus_queue.cc:1048] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.686553 4010 tablet_bootstrap.cc:492] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:40.688736 4006 consensus_queue.cc:260] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.690253 3961 raft_consensus.cc:2468] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:40.667783 4005 tablet_bootstrap.cc:654] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.672411 4040 leader_election.cc:290] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:40.694084 4046 consensus_queue.cc:1048] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.695477 4006 ts_tablet_manager.cc:1434] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.022s user 0.003s sys 0.003s
I20251215 20:53:40.695950 4046 raft_consensus.cc:493] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.696166 4007 tablet_bootstrap.cc:654] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.698701 4006 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:40.708364 4103 raft_consensus.cc:493] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.711295 4103 raft_consensus.cc:515] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.713162 4103 leader_election.cc:290] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:40.704528 4046 raft_consensus.cc:515] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.714090 4006 tablet_bootstrap.cc:654] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.713954 3779 leader_election.cc:304] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:40.715852 4046 leader_election.cc:290] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:40.720901 4010 tablet_bootstrap.cc:654] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.724845 4016 raft_consensus.cc:2804] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.732813 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c98269ae53148f29fa1722a088a3c71" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.734236 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.734974 3884 raft_consensus.cc:2468] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
W20251215 20:53:40.741034 3704 leader_election.cc:343] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:40.747288 3704 leader_election.cc:343] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.735483 4046 raft_consensus.cc:493] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.759280 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:40.760596 4007 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:40.761150 4007 ts_tablet_manager.cc:1403] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.081s user 0.011s sys 0.000s
I20251215 20:53:40.769634 4010 tablet_bootstrap.cc:492] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:40.770179 4010 ts_tablet_manager.cc:1403] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.084s user 0.008s sys 0.006s
I20251215 20:53:40.757413 4016 raft_consensus.cc:697] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:40.754891 4046 raft_consensus.cc:515] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.774381 4016 consensus_queue.cc:237] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
W20251215 20:53:40.774519 3703 leader_election.cc:343] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.778160 4058 raft_consensus.cc:493] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.780458 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c98269ae53148f29fa1722a088a3c71" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:40.780962 4011 leader_election.cc:290] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:40.786983 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:40.787534 3961 raft_consensus.cc:3060] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.787776 4006 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:40.788275 4006 ts_tablet_manager.cc:1403] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.090s user 0.032s sys 0.010s
I20251215 20:53:40.790386 4007 raft_consensus.cc:359] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.791040 4007 raft_consensus.cc:385] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.790732 4006 raft_consensus.cc:359] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.791311 4007 raft_consensus.cc:740] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.791491 4006 raft_consensus.cc:385] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.792084 4006 raft_consensus.cc:740] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.792771 4006 consensus_queue.cc:260] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.794066 4007 consensus_queue.cc:260] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.785375 3703 leader_election.cc:304] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.786304 4058 raft_consensus.cc:515] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.797848 4178 raft_consensus.cc:2749] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.798305 4040 consensus_queue.cc:1048] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.799623 4058 leader_election.cc:290] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.800743 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "820e3cc7d81046f1b3436c369048939e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:40.801378 3735 raft_consensus.cc:2468] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:40.805511 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "820e3cc7d81046f1b3436c369048939e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.808312 3851 leader_election.cc:304] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
W20251215 20:53:40.808887 3853 leader_election.cc:343] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.809159 4058 raft_consensus.cc:2804] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.809557 4058 raft_consensus.cc:493] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.809875 4058 raft_consensus.cc:3060] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.814359 4006 ts_tablet_manager.cc:1434] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20251215 20:53:40.814474 4007 ts_tablet_manager.cc:1434] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.053s user 0.006s sys 0.000s
I20251215 20:53:40.815099 4006 tablet_bootstrap.cc:492] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:40.815336 4007 tablet_bootstrap.cc:492] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
W20251215 20:53:40.820818 3703 leader_election.cc:343] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.821285 3703 leader_election.cc:304] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.821976 4011 raft_consensus.cc:2749] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.823768 3961 raft_consensus.cc:2468] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:40.824621 4046 leader_election.cc:290] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:40.826280 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:40.826927 4191 raft_consensus.cc:493] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.827164 3704 leader_election.cc:304] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.827441 4191 raft_consensus.cc:515] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.828265 4046 raft_consensus.cc:2804] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.829078 4046 raft_consensus.cc:697] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:40.829305 4191 leader_election.cc:290] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
W20251215 20:53:40.830040 3704 leader_election.cc:343] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.831094 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92aa097b972542fe997003b6178e7e41" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:40.831094 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92aa097b972542fe997003b6178e7e41" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:40.831771 4046 consensus_queue.cc:237] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.832541 3735 raft_consensus.cc:2468] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
W20251215 20:53:40.833715 3926 leader_election.cc:343] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.834599 3925 leader_election.cc:304] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.835705 4191 raft_consensus.cc:2804] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.836315 4191 raft_consensus.cc:493] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.828616 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:40.836764 4191 raft_consensus.cc:3060] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:40.837798 3703 leader_election.cc:343] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.838227 3703 leader_election.cc:304] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.838958 4011 raft_consensus.cc:2749] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:40.845816 4007 tablet_bootstrap.cc:654] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.853245 4010 raft_consensus.cc:359] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.854926 4010 raft_consensus.cc:385] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.855166 4010 raft_consensus.cc:740] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.855720 4010 consensus_queue.cc:260] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.845950 4058 raft_consensus.cc:515] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.843809 4191 raft_consensus.cc:515] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.860031 4010 ts_tablet_manager.cc:1434] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.090s user 0.002s sys 0.005s
I20251215 20:53:40.862807 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92aa097b972542fe997003b6178e7e41" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:40.864392 3926 leader_election.cc:343] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.866434 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92aa097b972542fe997003b6178e7e41" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:40.867015 3735 raft_consensus.cc:3060] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.867111 3636 catalog_manager.cc:5654] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:40.869159 3684 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:53:40.864171 4010 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:40.871867 4006 tablet_bootstrap.cc:654] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.876266 4010 tablet_bootstrap.cc:654] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.885460 3633 catalog_manager.cc:5654] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:40.890007 4005 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:40.890471 4005 ts_tablet_manager.cc:1403] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.229s user 0.023s sys 0.015s
I20251215 20:53:40.896422 4191 leader_election.cc:290] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:40.910017 4210 consensus_queue.cc:1048] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:40.924921 4058 leader_election.cc:290] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.930845 4006 tablet_bootstrap.cc:492] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:40.931335 4006 ts_tablet_manager.cc:1403] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.116s user 0.007s sys 0.011s
I20251215 20:53:40.922235 4165 consensus_queue.cc:1048] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20251215 20:53:40.930899 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "820e3cc7d81046f1b3436c369048939e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:40.933825 4006 raft_consensus.cc:359] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.935983 4006 raft_consensus.cc:385] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.936210 4006 raft_consensus.cc:740] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.936837 4006 consensus_queue.cc:260] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.935354 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "820e3cc7d81046f1b3436c369048939e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:40.929520 4191 raft_consensus.cc:493] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.948604 4006 ts_tablet_manager.cc:1434] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20251215 20:53:40.949388 4006 tablet_bootstrap.cc:492] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:40.949390 3736 raft_consensus.cc:3060] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.951093 3735 raft_consensus.cc:2468] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:40.945678 4191 raft_consensus.cc:515] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.955421 4191 leader_election.cc:290] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:40.957118 3736 raft_consensus.cc:2468] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:40.957268 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
W20251215 20:53:40.949896 3853 leader_election.cc:343] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.972429 4011 consensus_queue.cc:1048] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:40.958608 3925 leader_election.cc:304] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:40.958763 4257 raft_consensus.cc:493] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:40.960837 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:40.961697 4006 tablet_bootstrap.cc:654] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.962551 4005 raft_consensus.cc:359] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.974114 4005 raft_consensus.cc:385] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.970007 4007 tablet_bootstrap.cc:492] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:40.974403 4005 raft_consensus.cc:740] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.974740 4007 ts_tablet_manager.cc:1403] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.160s user 0.021s sys 0.014s
I20251215 20:53:40.975057 4005 consensus_queue.cc:260] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.976549 3738 raft_consensus.cc:2468] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:40.977190 4005 ts_tablet_manager.cc:1434] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.086s user 0.004s sys 0.001s
I20251215 20:53:40.978147 4005 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:40.978204 4128 raft_consensus.cc:2804] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.978317 3851 leader_election.cc:304] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:40.978792 4128 raft_consensus.cc:697] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:40.979079 4257 raft_consensus.cc:515] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:40.980484 4165 raft_consensus.cc:2804] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:40.978823 3925 leader_election.cc:304] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:40.980981 4165 raft_consensus.cc:697] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:40.981813 4165 consensus_queue.cc:237] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:40.982679 4043 raft_consensus.cc:2804] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:40.983055 4043 raft_consensus.cc:493] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:40.983383 4043 raft_consensus.cc:3060] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:40.981941 4007 raft_consensus.cc:359] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.984140 4005 tablet_bootstrap.cc:654] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:40.986176 4257 leader_election.cc:290] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:40.979642 4128 consensus_queue.cc:237] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:40.983981 4007 raft_consensus.cc:385] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:40.990154 4007 raft_consensus.cc:740] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:40.991084 4007 consensus_queue.cc:260] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:40.987141 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
W20251215 20:53:40.994329 3927 leader_election.cc:343] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:40.994390 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:40.998112 4007 ts_tablet_manager.cc:1434] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20251215 20:53:40.999110 4007 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:41.034556 4010 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:41.035072 4010 ts_tablet_manager.cc:1403] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.171s user 0.021s sys 0.024s
I20251215 20:53:41.038637 4178 raft_consensus.cc:493] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.039172 4178 raft_consensus.cc:515] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.041029 3633 catalog_manager.cc:5654] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:41.012387 4058 raft_consensus.cc:493] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.031080 4043 raft_consensus.cc:515] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
W20251215 20:53:41.048698 3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 63822.1us
I20251215 20:53:41.054553 4010 raft_consensus.cc:359] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.058763 4010 raft_consensus.cc:385] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.059074 4010 raft_consensus.cc:740] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.059684 4010 consensus_queue.cc:260] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.057289 4006 tablet_bootstrap.cc:492] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.060801 4006 ts_tablet_manager.cc:1403] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.112s user 0.014s sys 0.004s
I20251215 20:53:41.063148 4165 raft_consensus.cc:493] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.063728 4165 raft_consensus.cc:515] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.061209 4256 raft_consensus.cc:493] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.064954 4256 raft_consensus.cc:515] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:41.060261 3926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45041, user_credentials={real_user=slave}} blocked reactor thread for 61073.9us
I20251215 20:53:41.049024 4058 raft_consensus.cc:515] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.078632 3779 leader_election.cc:304] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:41.082284 4058 leader_election.cc:290] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.083050 4165 leader_election.cc:290] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:41.083791 4040 raft_consensus.cc:2749] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.084476 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6371592021d429ba136b0ef52728bbb" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.085198 3813 raft_consensus.cc:2468] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:41.084437 3811 raft_consensus.cc:3060] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.086078 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a03f70d92df4d41bdf5049341172bc4" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.087108 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.087802 4011 raft_consensus.cc:493] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.088238 4011 raft_consensus.cc:515] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.088605 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:41.088897 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6371592021d429ba136b0ef52728bbb" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.089512 3958 raft_consensus.cc:2468] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:41.090066 4011 leader_election.cc:290] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.091657 4256 leader_election.cc:290] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:41.091773 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:41.091991 3704 leader_election.cc:343] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.074994 4178 leader_election.cc:290] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
W20251215 20:53:41.092971 3703 leader_election.cc:343] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.093637 3853 leader_election.cc:304] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:41.094496 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467dc89c982a488b8a405d00a9f39247" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:41.099234 4010 ts_tablet_manager.cc:1434] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.064s user 0.006s sys 0.002s
I20251215 20:53:41.100044 4010 tablet_bootstrap.cc:492] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:41.104786 4005 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.105150 4005 ts_tablet_manager.cc:1403] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.127s user 0.036s sys 0.038s
I20251215 20:53:41.104990 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467dc89c982a488b8a405d00a9f39247" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:41.105621 3737 raft_consensus.cc:2468] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:41.097131 4058 raft_consensus.cc:2804] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.106683 3777 leader_election.cc:304] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:41.107641 4256 raft_consensus.cc:2804] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.107416 4006 raft_consensus.cc:359] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.107991 4256 raft_consensus.cc:493] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.108054 4006 raft_consensus.cc:385] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.108431 4006 raft_consensus.cc:740] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.095080 3885 raft_consensus.cc:2468] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:41.109035 4006 consensus_queue.cc:260] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.113781 4007 tablet_bootstrap.cc:654] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.115262 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a03f70d92df4d41bdf5049341172bc4" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.106714 4058 raft_consensus.cc:493] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.118758 4058 raft_consensus.cc:3060] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.108423 4256 raft_consensus.cc:3060] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.116190 4005 raft_consensus.cc:359] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.120818 4005 raft_consensus.cc:385] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.121100 4005 raft_consensus.cc:740] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.121685 4005 consensus_queue.cc:260] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.123898 4043 leader_election.cc:290] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.133268 3851 leader_election.cc:304] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:41.134093 4165 raft_consensus.cc:2749] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.139628 4006 ts_tablet_manager.cc:1434] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.079s user 0.006s sys 0.000s
I20251215 20:53:41.140339 4006 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:41.141726 4011 raft_consensus.cc:493] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.143873 4005 ts_tablet_manager.cc:1434] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20251215 20:53:41.145530 4005 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:41.138789 4043 raft_consensus.cc:493] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.148332 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.146641 4011 raft_consensus.cc:515] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.154503 4011 leader_election.cc:290] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
W20251215 20:53:41.155789 3704 leader_election.cc:343] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.156088 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd353b21737a444a83aad51cf35b0050" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.156205 3704 leader_election.cc:304] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
W20251215 20:53:41.157505 3704 leader_election.cc:343] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.159200 4103 raft_consensus.cc:2749] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.150673 4043 raft_consensus.cc:515] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.161171 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd353b21737a444a83aad51cf35b0050" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.162806 3809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:41.165203 4043 leader_election.cc:290] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:41.165515 3884 raft_consensus.cc:3060] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.167268 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:41.168170 3704 leader_election.cc:343] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.168835 3704 leader_election.cc:304] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:41.170858 4178 raft_consensus.cc:2749] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:53:41.171644 3926 leader_election.cc:343] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.166407 3958 raft_consensus.cc:2468] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
W20251215 20:53:41.173906 3704 consensus_peers.cc:597] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:41.175163 4010 tablet_bootstrap.cc:654] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:41.176553 3927 leader_election.cc:343] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.179297 4256 raft_consensus.cc:515] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.181670 4256 leader_election.cc:290] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:41.179914 4006 tablet_bootstrap.cc:654] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.182885 4005 tablet_bootstrap.cc:654] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.182746 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467dc89c982a488b8a405d00a9f39247" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:41.183370 3885 raft_consensus.cc:3060] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.187692 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "467dc89c982a488b8a405d00a9f39247" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:41.188333 3737 raft_consensus.cc:3060] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.197264 3704 leader_election.cc:304] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:41.197964 4103 raft_consensus.cc:2804] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.198314 4103 raft_consensus.cc:493] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.198613 4103 raft_consensus.cc:3060] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.200446 4256 consensus_queue.cc:1048] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.203089 4058 raft_consensus.cc:515] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.207023 4103 raft_consensus.cc:515] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.210384 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6371592021d429ba136b0ef52728bbb" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:41.210973 3812 raft_consensus.cc:3060] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.212841 3633 catalog_manager.cc:5654] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:41.215999 3885 raft_consensus.cc:2468] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:41.217373 4007 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:41.221505 3812 raft_consensus.cc:2468] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:41.222536 3853 leader_election.cc:304] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:41.223278 4210 raft_consensus.cc:2804] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.223752 4210 raft_consensus.cc:697] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:41.224581 4210 consensus_queue.cc:237] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.225685 3778 leader_election.cc:304] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:41.226501 4256 raft_consensus.cc:2804] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.228150 4007 ts_tablet_manager.cc:1403] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.229s user 0.014s sys 0.009s
I20251215 20:53:41.226866 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:41.231964 4058 leader_election.cc:290] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.233644 4103 leader_election.cc:290] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.236804 4005 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.237345 4005 ts_tablet_manager.cc:1403] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.092s user 0.017s sys 0.014s
I20251215 20:53:41.226933 4256 raft_consensus.cc:697] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:41.238268 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:41.238624 4006 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.239111 4006 ts_tablet_manager.cc:1403] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.099s user 0.013s sys 0.007s
I20251215 20:53:41.239362 3958 raft_consensus.cc:3060] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.240909 3737 raft_consensus.cc:2468] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
W20251215 20:53:41.240991 3703 leader_election.cc:343] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.242136 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:41.253441 3738 raft_consensus.cc:3060] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.243129 4006 raft_consensus.cc:359] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.262218 4006 raft_consensus.cc:385] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 20:53:41.262240 3703 consensus_peers.cc:597] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:41.262564 4006 raft_consensus.cc:740] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.244892 4256 consensus_queue.cc:237] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.244685 4005 raft_consensus.cc:359] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.263276 4005 raft_consensus.cc:385] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.263573 4005 raft_consensus.cc:740] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.248119 3958 raft_consensus.cc:2468] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:41.249228 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6371592021d429ba136b0ef52728bbb" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:41.264632 3961 raft_consensus.cc:3060] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.265807 4006 consensus_queue.cc:260] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.268167 4016 consensus_queue.cc:1048] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.269129 4006 ts_tablet_manager.cc:1434] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.030s user 0.006s sys 0.001s
I20251215 20:53:41.270036 4006 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:41.269701 3633 catalog_manager.cc:5654] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:41.260011 3738 raft_consensus.cc:2468] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:41.271184 3961 raft_consensus.cc:2468] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:41.264225 4005 consensus_queue.cc:260] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.275681 4005 ts_tablet_manager.cc:1434] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.038s user 0.007s sys 0.000s
I20251215 20:53:41.249667 4007 raft_consensus.cc:359] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.276358 4007 raft_consensus.cc:385] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.276640 4007 raft_consensus.cc:740] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.277207 4007 consensus_queue.cc:260] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.277585 4058 raft_consensus.cc:493] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.278038 4058 raft_consensus.cc:515] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.279259 4007 ts_tablet_manager.cc:1434] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.051s user 0.003s sys 0.000s
I20251215 20:53:41.279826 4058 leader_election.cc:290] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.252491 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:41.280158 4005 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:41.281049 3736 raft_consensus.cc:2393] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:41.281365 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a21e159520040a682326bc0b83248ff" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.282172 3704 leader_election.cc:304] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:41.282898 4103 raft_consensus.cc:2804] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.283325 4103 raft_consensus.cc:697] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:41.284087 4103 consensus_queue.cc:237] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.280153 4007 tablet_bootstrap.cc:492] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:41.286972 4005 tablet_bootstrap.cc:654] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:41.288416 3853 leader_election.cc:343] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.289996 4006 tablet_bootstrap.cc:654] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.290561 4016 raft_consensus.cc:493] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.291072 4016 raft_consensus.cc:515] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.286618 4010 tablet_bootstrap.cc:492] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:41.292770 4010 ts_tablet_manager.cc:1403] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.193s user 0.018s sys 0.002s
I20251215 20:53:41.293002 4016 leader_election.cc:290] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:41.293640 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "820e3cc7d81046f1b3436c369048939e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:41.294365 3736 raft_consensus.cc:2393] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:41.294577 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "820e3cc7d81046f1b3436c369048939e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:41.295405 4010 raft_consensus.cc:359] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.296110 3778 leader_election.cc:304] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:41.297333 4016 raft_consensus.cc:3060] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.298753 4005 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.299176 4005 ts_tablet_manager.cc:1403] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.008s
I20251215 20:53:41.300974 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a21e159520040a682326bc0b83248ff" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.301608 3958 raft_consensus.cc:2468] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:41.300907 3925 leader_election.cc:304] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:41.304955 4273 raft_consensus.cc:2804] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.305397 4273 raft_consensus.cc:697] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:41.305341 3925 leader_election.cc:304] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:41.296089 4010 raft_consensus.cc:385] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.306196 4010 raft_consensus.cc:740] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.306305 4273 consensus_queue.cc:237] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.306838 4010 consensus_queue.cc:260] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.309226 4010 ts_tablet_manager.cc:1434] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20251215 20:53:41.310034 4010 tablet_bootstrap.cc:492] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:41.310708 4005 raft_consensus.cc:359] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.311321 4005 raft_consensus.cc:385] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.311554 4005 raft_consensus.cc:740] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.312312 4005 consensus_queue.cc:260] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.313355 3634 catalog_manager.cc:5654] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:41.314456 4005 ts_tablet_manager.cc:1434] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20251215 20:53:41.315337 4005 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:41.315812 4010 tablet_bootstrap.cc:654] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.318558 4191 raft_consensus.cc:2749] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.321908 4016 raft_consensus.cc:2749] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.323161 3853 leader_election.cc:304] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:41.323933 4058 raft_consensus.cc:2804] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.324268 4058 raft_consensus.cc:493] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.324615 4058 raft_consensus.cc:3060] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.325387 4005 tablet_bootstrap.cc:654] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.319671 3633 catalog_manager.cc:5654] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:41.329834 4007 tablet_bootstrap.cc:654] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.341897 4058 raft_consensus.cc:515] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.344065 4058 leader_election.cc:290] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.344724 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a21e159520040a682326bc0b83248ff" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
W20251215 20:53:41.346779 3853 leader_election.cc:343] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.348482 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a21e159520040a682326bc0b83248ff" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:41.349144 3958 raft_consensus.cc:3060] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.361884 3958 raft_consensus.cc:2468] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:41.363713 3853 leader_election.cc:304] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:41.365131 4058 raft_consensus.cc:2804] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.365969 4005 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.366547 4005 ts_tablet_manager.cc:1403] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.008s
I20251215 20:53:41.370396 4005 raft_consensus.cc:359] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.371093 4005 raft_consensus.cc:385] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.371352 4005 raft_consensus.cc:740] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.365965 4058 raft_consensus.cc:697] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:41.372069 4005 consensus_queue.cc:260] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.376180 4005 ts_tablet_manager.cc:1434] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20251215 20:53:41.373430 4058 consensus_queue.cc:237] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.385598 4191 raft_consensus.cc:493] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.386060 4191 raft_consensus.cc:515] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.386919 4005 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:41.390528 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.391237 3812 raft_consensus.cc:2468] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:41.386544 4006 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.393606 4006 ts_tablet_manager.cc:1403] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.124s user 0.019s sys 0.000s
I20251215 20:53:41.396000 4006 raft_consensus.cc:359] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.396816 3927 leader_election.cc:304] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:41.397825 4273 raft_consensus.cc:2804] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.398154 4273 raft_consensus.cc:493] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.398452 4273 raft_consensus.cc:3060] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.399904 4046 raft_consensus.cc:493] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.400367 4046 raft_consensus.cc:515] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.402129 4046 leader_election.cc:290] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.403759 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:41.404670 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.405095 4210 consensus_queue.cc:1048] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:53:41.406996 3703 leader_election.cc:343] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.396117 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:41.414328 4046 consensus_queue.cc:1048] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:41.388010 4191 leader_election.cc:290] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
W20251215 20:53:41.416740 3926 leader_election.cc:343] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.396639 4006 raft_consensus.cc:385] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.417286 4006 raft_consensus.cc:740] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.418784 4006 consensus_queue.cc:260] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.419661 3959 raft_consensus.cc:2468] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:41.421561 4005 tablet_bootstrap.cc:654] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.426261 4006 ts_tablet_manager.cc:1434] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20251215 20:53:41.427249 4006 tablet_bootstrap.cc:492] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:41.411911 4273 raft_consensus.cc:515] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.434916 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:41.435753 3812 raft_consensus.cc:3060] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.441985 4005 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.442670 3812 raft_consensus.cc:2468] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:41.443902 3927 leader_election.cc:304] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:41.444940 4043 raft_consensus.cc:2804] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.445622 4043 raft_consensus.cc:697] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:41.446239 4268 consensus_queue.cc:1048] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.446442 4043 consensus_queue.cc:237] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.450284 4165 raft_consensus.cc:493] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.450795 4165 raft_consensus.cc:515] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.453477 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c98269ae53148f29fa1722a088a3c71" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:41.453580 4165 leader_election.cc:290] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.454156 3737 raft_consensus.cc:2468] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:41.455302 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c98269ae53148f29fa1722a088a3c71" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.458209 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:41.458886 3853 leader_election.cc:343] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.459259 4005 ts_tablet_manager.cc:1403] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.078s user 0.008s sys 0.003s
I20251215 20:53:41.459561 4273 leader_election.cc:290] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:41.459743 3851 leader_election.cc:304] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
W20251215 20:53:41.461162 3926 leader_election.cc:343] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.461889 3704 leader_election.cc:304] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:41.463012 4165 raft_consensus.cc:2804] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.463694 4007 tablet_bootstrap.cc:492] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:41.463968 4165 raft_consensus.cc:493] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.463498 4046 raft_consensus.cc:2804] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.464159 4007 ts_tablet_manager.cc:1403] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.184s user 0.012s sys 0.025s
I20251215 20:53:41.464557 4046 raft_consensus.cc:493] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.464962 4046 raft_consensus.cc:3060] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.466440 4165 raft_consensus.cc:3060] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.469072 3636 catalog_manager.cc:5654] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:41.468334 4007 raft_consensus.cc:359] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.471030 4007 raft_consensus.cc:385] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.471278 4007 raft_consensus.cc:740] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.473150 4007 consensus_queue.cc:260] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.476042 3634 catalog_manager.cc:5654] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:41.478863 4007 ts_tablet_manager.cc:1434] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20251215 20:53:41.480459 4007 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:41.482612 4005 raft_consensus.cc:359] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.483284 4005 raft_consensus.cc:385] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.483558 4005 raft_consensus.cc:740] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.484616 4006 tablet_bootstrap.cc:654] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.485690 4005 consensus_queue.cc:260] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.487843 4005 ts_tablet_manager.cc:1434] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.028s user 0.004s sys 0.000s
I20251215 20:53:41.488737 4005 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
W20251215 20:53:41.490839 3926 consensus_peers.cc:597] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:41.497040 4007 tablet_bootstrap.cc:654] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.496971 4005 tablet_bootstrap.cc:654] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.501636 4006 tablet_bootstrap.cc:492] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.501986 4006 ts_tablet_manager.cc:1403] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.075s user 0.011s sys 0.000s
I20251215 20:53:41.503711 4006 raft_consensus.cc:359] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.504164 4006 raft_consensus.cc:385] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.504441 4006 raft_consensus.cc:740] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.506095 4010 tablet_bootstrap.cc:492] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:41.506548 4010 ts_tablet_manager.cc:1403] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.197s user 0.038s sys 0.046s
I20251215 20:53:41.506788 4006 consensus_queue.cc:260] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.508980 4010 raft_consensus.cc:359] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.509663 4010 raft_consensus.cc:385] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.509920 4010 raft_consensus.cc:740] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.510125 4006 ts_tablet_manager.cc:1434] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:53:41.510329 4058 consensus_queue.cc:1048] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.510579 4010 consensus_queue.cc:260] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.515102 4007 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:41.515607 4007 ts_tablet_manager.cc:1403] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.000s
I20251215 20:53:41.516208 4010 ts_tablet_manager.cc:1434] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20251215 20:53:41.517275 4010 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:41.518268 4006 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:41.524161 4275 raft_consensus.cc:493] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.524979 4275 raft_consensus.cc:515] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.525338 4165 raft_consensus.cc:515] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.526990 4275 leader_election.cc:290] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.527096 4165 leader_election.cc:290] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.527415 4010 tablet_bootstrap.cc:654] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.528972 4046 raft_consensus.cc:515] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.529174 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aef546d01dde465191d2485943bf84b1" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.529929 3959 raft_consensus.cc:2468] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:41.532867 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c98269ae53148f29fa1722a088a3c71" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:41.534215 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aef546d01dde465191d2485943bf84b1" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.534838 3811 raft_consensus.cc:2468] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
W20251215 20:53:41.535708 3853 leader_election.cc:343] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.535938 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:41.536492 3959 raft_consensus.cc:3060] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.536859 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:41.534998 4046 leader_election.cc:290] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.536443 3853 leader_election.cc:304] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
W20251215 20:53:41.538367 3703 leader_election.cc:343] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.540120 4058 raft_consensus.cc:2804] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.540513 4058 raft_consensus.cc:493] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.540828 4058 raft_consensus.cc:3060] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.545140 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c98269ae53148f29fa1722a088a3c71" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:41.546240 3736 raft_consensus.cc:3060] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.545703 3959 raft_consensus.cc:2468] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:41.549633 3704 leader_election.cc:304] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:41.550316 4046 raft_consensus.cc:2804] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.550762 4046 raft_consensus.cc:697] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:41.551532 4046 consensus_queue.cc:237] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.552927 4058 raft_consensus.cc:515] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.556492 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aef546d01dde465191d2485943bf84b1" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:41.557060 3812 raft_consensus.cc:3060] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.561936 4007 raft_consensus.cc:359] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.562623 4010 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:41.568684 4010 ts_tablet_manager.cc:1403] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.005s
I20251215 20:53:41.568852 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aef546d01dde465191d2485943bf84b1" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:41.569404 3958 raft_consensus.cc:3060] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.569672 3812 raft_consensus.cc:2468] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:41.570765 3853 leader_election.cc:304] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:41.571161 4010 raft_consensus.cc:359] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.571573 4275 raft_consensus.cc:2804] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.571841 4010 raft_consensus.cc:385] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.572197 4010 raft_consensus.cc:740] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.573112 4010 consensus_queue.cc:260] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.563374 3736 raft_consensus.cc:2468] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:41.567945 4273 raft_consensus.cc:493] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.574066 4273 raft_consensus.cc:515] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.574640 4058 leader_election.cc:290] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.574273 4275 raft_consensus.cc:697] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:41.575882 4273 leader_election.cc:290] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.576489 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a03f70d92df4d41bdf5049341172bc4" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:41.577102 3737 raft_consensus.cc:2468] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:41.577481 3851 leader_election.cc:304] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:41.578004 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a03f70d92df4d41bdf5049341172bc4" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.578399 3925 leader_election.cc:304] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
W20251215 20:53:41.579178 3927 leader_election.cc:343] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.579281 4010 ts_tablet_manager.cc:1434] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20251215 20:53:41.575616 4275 consensus_queue.cc:237] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.580407 4007 raft_consensus.cc:385] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.581096 4058 raft_consensus.cc:2804] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.573583 4006 tablet_bootstrap.cc:654] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.580757 4007 raft_consensus.cc:740] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.580183 4010 tablet_bootstrap.cc:492] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:41.582649 4007 consensus_queue.cc:260] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.586150 4007 ts_tablet_manager.cc:1434] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.070s user 0.007s sys 0.000s
I20251215 20:53:41.585382 4273 raft_consensus.cc:2804] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.586997 4273 raft_consensus.cc:493] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.587324 4273 raft_consensus.cc:3060] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.587630 4007 tablet_bootstrap.cc:492] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:41.587970 4005 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.593628 4005 ts_tablet_manager.cc:1403] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.105s user 0.017s sys 0.009s
I20251215 20:53:41.597798 3633 catalog_manager.cc:5654] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:41.598572 4010 tablet_bootstrap.cc:654] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.583678 4058 raft_consensus.cc:697] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:41.604513 4058 consensus_queue.cc:237] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.605665 3958 raft_consensus.cc:2468] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:41.608225 4005 raft_consensus.cc:359] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.608486 4273 raft_consensus.cc:515] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.610929 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a03f70d92df4d41bdf5049341172bc4" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:41.611379 4273 leader_election.cc:290] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.611433 3736 raft_consensus.cc:3060] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.611979 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a03f70d92df4d41bdf5049341172bc4" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
W20251215 20:53:41.613265 3927 leader_election.cc:343] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.612200 4006 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.614065 4006 ts_tablet_manager.cc:1403] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.096s user 0.011s sys 0.003s
I20251215 20:53:41.614411 4103 raft_consensus.cc:493] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.614858 4103 raft_consensus.cc:515] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.616479 4006 raft_consensus.cc:359] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.617219 4006 raft_consensus.cc:385] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.617484 4006 raft_consensus.cc:740] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.618131 4006 consensus_queue.cc:260] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.618644 3736 raft_consensus.cc:2468] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:41.608889 4005 raft_consensus.cc:385] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.619678 4005 raft_consensus.cc:740] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.619690 3925 leader_election.cc:304] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:41.619980 4006 ts_tablet_manager.cc:1434] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:53:41.620417 4005 consensus_queue.cc:260] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.620931 4273 raft_consensus.cc:2804] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.621649 4273 raft_consensus.cc:697] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:41.622617 4273 consensus_queue.cc:237] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.623169 4005 ts_tablet_manager.cc:1434] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.029s user 0.005s sys 0.000s
I20251215 20:53:41.624023 4103 leader_election.cc:290] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.621567 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b302275303b54dc3a70558581fd3ae49" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:41.625476 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b302275303b54dc3a70558581fd3ae49" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
W20251215 20:53:41.626721 3704 leader_election.cc:343] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:41.627629 3703 leader_election.cc:343] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.627851 4005 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:41.628129 3703 leader_election.cc:304] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:41.629209 4046 raft_consensus.cc:493] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.629633 4046 raft_consensus.cc:515] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.630288 4007 tablet_bootstrap.cc:654] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.632035 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a5c0bc6cfd443bb366d645e217dbe7" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.632103 3633 catalog_manager.cc:5654] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:41.632943 4103 raft_consensus.cc:2749] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.633072 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a5c0bc6cfd443bb366d645e217dbe7" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
W20251215 20:53:41.634027 3704 leader_election.cc:343] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.633893 3633 catalog_manager.cc:5654] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:41.634635 3704 leader_election.cc:343] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.634847 4006 tablet_bootstrap.cc:492] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:41.635612 4046 leader_election.cc:290] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.635028 3704 leader_election.cc:304] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:41.639763 4046 raft_consensus.cc:2749] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.640698 4006 tablet_bootstrap.cc:654] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.644884 4005 tablet_bootstrap.cc:654] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.645628 4006 tablet_bootstrap.cc:492] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.645651 4010 tablet_bootstrap.cc:492] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:41.646209 4010 ts_tablet_manager.cc:1403] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.012s
I20251215 20:53:41.646209 4006 ts_tablet_manager.cc:1403] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.001s
I20251215 20:53:41.648715 4010 raft_consensus.cc:359] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.649320 4010 raft_consensus.cc:385] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.649562 4010 raft_consensus.cc:740] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.650512 4006 raft_consensus.cc:359] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.651168 4006 raft_consensus.cc:385] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.651435 4006 raft_consensus.cc:740] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.652136 4006 consensus_queue.cc:260] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.654304 4006 ts_tablet_manager.cc:1434] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20251215 20:53:41.655155 4006 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:41.657728 3634 catalog_manager.cc:5654] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:41.660279 4006 tablet_bootstrap.cc:654] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.666044 4010 consensus_queue.cc:260] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.684340 4005 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.685832 4005 ts_tablet_manager.cc:1403] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.058s user 0.017s sys 0.005s
I20251215 20:53:41.689442 3633 catalog_manager.cc:5654] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:41.691326 4006 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.691771 4006 ts_tablet_manager.cc:1403] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.037s user 0.017s sys 0.007s
I20251215 20:53:41.688553 4005 raft_consensus.cc:359] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.699031 4005 raft_consensus.cc:385] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.699698 4005 raft_consensus.cc:740] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.703236 4010 ts_tablet_manager.cc:1434] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.057s user 0.005s sys 0.001s
I20251215 20:53:41.710877 4010 tablet_bootstrap.cc:492] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:41.710578 4005 consensus_queue.cc:260] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.712330 4005 ts_tablet_manager.cc:1434] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20251215 20:53:41.700212 4006 raft_consensus.cc:359] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.716281 4006 raft_consensus.cc:385] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.716370 4005 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:41.717583 4010 tablet_bootstrap.cc:654] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:41.719376 3927 consensus_peers.cc:597] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:41.708870 4007 tablet_bootstrap.cc:492] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:41.716693 4006 raft_consensus.cc:740] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.720206 4007 ts_tablet_manager.cc:1403] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.133s user 0.029s sys 0.018s
I20251215 20:53:41.720525 4006 consensus_queue.cc:260] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.722741 4005 tablet_bootstrap.cc:654] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.723922 4006 ts_tablet_manager.cc:1434] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20251215 20:53:41.727007 4007 raft_consensus.cc:359] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.727710 4007 raft_consensus.cc:385] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.727988 4007 raft_consensus.cc:740] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.729079 4007 consensus_queue.cc:260] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.734458 4005 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.734956 4005 ts_tablet_manager.cc:1403] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.011s
I20251215 20:53:41.736042 4006 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:41.737371 4005 raft_consensus.cc:359] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.737810 4007 ts_tablet_manager.cc:1434] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.017s user 0.003s sys 0.002s
I20251215 20:53:41.738569 4005 raft_consensus.cc:385] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.738921 4005 raft_consensus.cc:740] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.739711 4010 tablet_bootstrap.cc:492] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:41.739636 4005 consensus_queue.cc:260] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.740229 4010 ts_tablet_manager.cc:1403] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.001s
I20251215 20:53:41.741605 4005 ts_tablet_manager.cc:1434] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20251215 20:53:41.742667 4005 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:41.743055 4007 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:41.743651 4006 tablet_bootstrap.cc:654] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.742667 4010 raft_consensus.cc:359] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.752214 4010 raft_consensus.cc:385] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.752548 4010 raft_consensus.cc:740] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.753671 4273 raft_consensus.cc:493] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.754217 4273 raft_consensus.cc:515] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.755455 4010 consensus_queue.cc:260] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.756271 4273 leader_election.cc:290] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.758550 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd353b21737a444a83aad51cf35b0050" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.759357 4007 tablet_bootstrap.cc:654] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:41.759831 3927 leader_election.cc:343] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.757535 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd353b21737a444a83aad51cf35b0050" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:41.758211 4046 raft_consensus.cc:493] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.762156 3736 raft_consensus.cc:2468] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:41.756465 4005 tablet_bootstrap.cc:654] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.762174 4046 raft_consensus.cc:515] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.764616 4046 leader_election.cc:290] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:41.766774 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0807745e47db47f7baefd68c4488a72d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.767918 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0807745e47db47f7baefd68c4488a72d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:41.757385 4010 ts_tablet_manager.cc:1434] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
W20251215 20:53:41.769855 3704 leader_election.cc:343] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.770263 4010 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:41.771000 3925 leader_election.cc:304] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:41.771270 4006 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.771749 4006 ts_tablet_manager.cc:1403] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.036s user 0.013s sys 0.006s
I20251215 20:53:41.773558 4273 raft_consensus.cc:2804] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.773900 4273 raft_consensus.cc:493] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.774227 4273 raft_consensus.cc:3060] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.774411 4005 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:41.774886 4005 ts_tablet_manager.cc:1403] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.012s
I20251215 20:53:41.777874 4010 tablet_bootstrap.cc:654] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.778458 4006 raft_consensus.cc:359] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.779338 4006 raft_consensus.cc:385] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.779629 4006 raft_consensus.cc:740] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
W20251215 20:53:41.782377 3703 leader_election.cc:343] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.782779 4006 consensus_queue.cc:260] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.786422 4006 ts_tablet_manager.cc:1434] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20251215 20:53:41.787765 4006 tablet_bootstrap.cc:492] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:41.782845 3703 leader_election.cc:304] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:41.792526 4099 raft_consensus.cc:2749] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.792783 3811 raft_consensus.cc:3060] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.792994 4006 tablet_bootstrap.cc:654] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.795312 4273 raft_consensus.cc:515] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.796440 4040 consensus_queue.cc:1048] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.798152 4058 raft_consensus.cc:493] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.798609 4058 raft_consensus.cc:515] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.800082 4178 raft_consensus.cc:493] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.800312 4058 leader_election.cc:290] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.800971 4099 consensus_queue.cc:1048] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.801403 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd353b21737a444a83aad51cf35b0050" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:41.801926 3736 raft_consensus.cc:3060] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.802021 4178 raft_consensus.cc:515] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.803982 4178 leader_election.cc:290] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.807806 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.809480 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
W20251215 20:53:41.810817 3704 leader_election.cc:343] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.802006 4005 raft_consensus.cc:359] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.811713 4005 raft_consensus.cc:385] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.812073 4005 raft_consensus.cc:740] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.819391 4005 consensus_queue.cc:260] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.824540 4010 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:41.825034 4010 ts_tablet_manager.cc:1403] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.055s user 0.016s sys 0.002s
I20251215 20:53:41.809720 4273 leader_election.cc:290] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.821084 3959 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:41.831423 4103 raft_consensus.cc:493] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.831615 3809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.832497 3809 raft_consensus.cc:2393] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:41.831617 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.833830 4040 consensus_queue.cc:1048] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.835517 3736 raft_consensus.cc:2468] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:41.835391 4010 raft_consensus.cc:359] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.836206 4010 raft_consensus.cc:385] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.836512 4010 raft_consensus.cc:740] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.836969 3704 leader_election.cc:304] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:41.837096 4010 consensus_queue.cc:260] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.839665 4046 raft_consensus.cc:2804] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.840039 4046 raft_consensus.cc:493] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.840389 4046 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.844586 4005 ts_tablet_manager.cc:1434] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.069s user 0.006s sys 0.001s
I20251215 20:53:41.845569 4005 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:41.844556 4007 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:41.842748 4103 raft_consensus.cc:515] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.849830 3853 leader_election.cc:304] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:41.848191 4010 ts_tablet_manager.cc:1434] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20251215 20:53:41.847741 4007 ts_tablet_manager.cc:1403] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.105s user 0.018s sys 0.014s
I20251215 20:53:41.850893 4275 consensus_queue.cc:1048] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.851438 4103 leader_election.cc:290] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.852068 4005 tablet_bootstrap.cc:654] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.853624 4007 raft_consensus.cc:359] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.854382 4007 raft_consensus.cc:385] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.854665 4007 raft_consensus.cc:740] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.855288 4007 consensus_queue.cc:260] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.856653 3925 leader_election.cc:304] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:41.857393 4268 raft_consensus.cc:2804] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.857987 4268 raft_consensus.cc:697] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:41.858534 4046 raft_consensus.cc:515] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.858748 4268 consensus_queue.cc:237] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.857457 4007 ts_tablet_manager.cc:1434] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:41.859846 3883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:41.861430 4007 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:41.852149 4275 raft_consensus.cc:3060] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.862582 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
W20251215 20:53:41.862974 3703 leader_election.cc:343] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:41.863790 3704 leader_election.cc:343] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.864007 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.864315 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:41.864683 3958 raft_consensus.cc:2468] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:41.864868 3959 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.868818 3704 leader_election.cc:304] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:41.868958 4006 tablet_bootstrap.cc:492] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:41.870172 4006 ts_tablet_manager.cc:1403] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.083s user 0.015s sys 0.014s
I20251215 20:53:41.871693 4103 raft_consensus.cc:2804] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:41.876616 4040 raft_consensus.cc:493] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.879909 3883 raft_consensus.cc:3060] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.881384 4165 consensus_queue.cc:1048] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.885632 4103 raft_consensus.cc:493] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:41.888962 4103 raft_consensus.cc:3060] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.890548 4275 raft_consensus.cc:2749] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:41.892683 4007 tablet_bootstrap.cc:654] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.859905 4046 leader_election.cc:290] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:41.887045 4040 raft_consensus.cc:515] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.897923 4040 leader_election.cc:290] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:41.899232 4103 raft_consensus.cc:515] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.899803 4010 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:41.900592 3736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a03f70d92df4d41bdf5049341172bc4" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:41.899328 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a03f70d92df4d41bdf5049341172bc4" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.901258 4103 leader_election.cc:290] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:41.902016 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:41.903374 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:41.904029 4058 consensus_queue.cc:1048] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.931546 4006 raft_consensus.cc:359] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.933508 4058 consensus_queue.cc:1048] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.932251 4006 raft_consensus.cc:385] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:41.935106 4006 raft_consensus.cc:740] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:41.932723 4046 raft_consensus.cc:493] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.937909 4006 consensus_queue.cc:260] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.919449 4273 raft_consensus.cc:493] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.941912 4006 ts_tablet_manager.cc:1434] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.057s user 0.006s sys 0.000s
I20251215 20:53:41.925354 3956 raft_consensus.cc:3060] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:41.921947 4040 raft_consensus.cc:493] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.944607 4006 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
W20251215 20:53:41.945670 3703 leader_election.cc:343] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:41.957734 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd353b21737a444a83aad51cf35b0050" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:41.941579 4046 raft_consensus.cc:515] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.948611 3959 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:41.960619 4046 leader_election.cc:290] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:41.942641 3736 raft_consensus.cc:2393] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:41.944747 4273 raft_consensus.cc:515] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:41.957755 4010 tablet_bootstrap.cc:654] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:41.963589 3704 leader_election.cc:304] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:41.966588 4007 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:41.967163 4007 ts_tablet_manager.cc:1403] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.106s user 0.017s sys 0.018s
I20251215 20:53:41.971585 4191 consensus_queue.cc:1048] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:41.977747 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "723425b3ad41419c9207bc5880db1c1c" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:41.968025 4103 raft_consensus.cc:2804] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:41.986483 4103 raft_consensus.cc:697] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:41.987350 4103 consensus_queue.cc:237] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:41.978907 4165 raft_consensus.cc:493] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.989398 4165 raft_consensus.cc:515] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:41.991138 4165 leader_election.cc:290] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:41.965224 4190 consensus_queue.cc:1048] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20251215 20:53:41.992689 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:41.963007 4040 raft_consensus.cc:515] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:41.996776 4268 raft_consensus.cc:493] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:41.997283 4268 raft_consensus.cc:515] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:42.024904 4040 leader_election.cc:290] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:42.026386 3887 raft_consensus.cc:3060] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.027398 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "723425b3ad41419c9207bc5880db1c1c" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.029198 4273 leader_election.cc:290] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:42.029748 4099 consensus_queue.cc:1048] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:42.042239 4005 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:42.042621 4005 ts_tablet_manager.cc:1403] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.197s user 0.028s sys 0.013s
I20251215 20:53:42.045603 4007 raft_consensus.cc:359] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.046156 4007 raft_consensus.cc:385] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.046344 4007 raft_consensus.cc:740] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.046787 4007 consensus_queue.cc:260] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:42.038465 3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 85084.3us
I20251215 20:53:42.054667 4268 leader_election.cc:290] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:42.063524 4007 ts_tablet_manager.cc:1434] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.096s user 0.005s sys 0.001s
I20251215 20:53:42.064635 4007 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
W20251215 20:53:42.040060 3778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45041, user_credentials={real_user=slave}} blocked reactor thread for 62397.4us
I20251215 20:53:42.080649 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.083120 3883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "652957cad9bb4393811a50c064710b1f" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.087376 3956 raft_consensus.cc:2468] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 1.
I20251215 20:53:42.091967 4006 tablet_bootstrap.cc:654] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.094532 4005 raft_consensus.cc:359] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.095233 4005 raft_consensus.cc:385] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.095486 4005 raft_consensus.cc:740] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
W20251215 20:53:42.095732 3927 leader_election.cc:343] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.096619 4005 consensus_queue.cc:260] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.105314 3636 catalog_manager.cc:5654] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:42.129448 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.130134 3737 raft_consensus.cc:2468] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:42.130728 4007 tablet_bootstrap.cc:654] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:42.133056 3684 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:53:42.133411 4005 ts_tablet_manager.cc:1434] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.091s user 0.002s sys 0.005s
I20251215 20:53:42.125273 4103 raft_consensus.cc:493] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.143306 4103 raft_consensus.cc:515] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.126343 4256 raft_consensus.cc:493] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.121094 3851 leader_election.cc:304] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
W20251215 20:53:42.149550 3704 leader_election.cc:343] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.150547 3704 leader_election.cc:304] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.154524 4338 raft_consensus.cc:2804] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:42.155033 4338 raft_consensus.cc:697] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:42.155809 4338 consensus_queue.cc:237] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.157570 4099 consensus_queue.cc:1048] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:42.162164 4005 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
W20251215 20:53:42.164760 3851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 47258.2us
I20251215 20:53:42.148798 4256 raft_consensus.cc:515] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
W20251215 20:53:42.166347 3926 leader_election.cc:343] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.176729 4165 raft_consensus.cc:2749] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:42.189926 3634 catalog_manager.cc:5654] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:42.202294 4103 leader_election.cc:290] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:42.203915 3809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "652957cad9bb4393811a50c064710b1f" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.214933 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:42.217232 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.233389 4010 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:42.235565 4007 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:42.237572 4335 consensus_queue.cc:1048] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:42.245558 4010 ts_tablet_manager.cc:1403] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.346s user 0.017s sys 0.026s
I20251215 20:53:42.245579 4007 ts_tablet_manager.cc:1403] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.181s user 0.009s sys 0.030s
I20251215 20:53:42.242117 4005 tablet_bootstrap.cc:654] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.243876 4345 raft_consensus.cc:493] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.244114 4006 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:42.247583 4006 ts_tablet_manager.cc:1403] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.303s user 0.008s sys 0.012s
I20251215 20:53:42.227169 3809 raft_consensus.cc:2468] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:42.259279 4007 raft_consensus.cc:359] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.259419 4010 raft_consensus.cc:359] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.259997 4007 raft_consensus.cc:385] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.260111 4010 raft_consensus.cc:385] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.260425 4010 raft_consensus.cc:740] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.260967 3777 leader_election.cc:304] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:42.262440 3777 leader_election.cc:304] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:42.261171 4010 consensus_queue.cc:260] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.263928 4330 raft_consensus.cc:2804] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:42.264266 4330 raft_consensus.cc:493] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:42.264616 4330 raft_consensus.cc:3060] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.264887 4010 ts_tablet_manager.cc:1434] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20251215 20:53:42.265730 4010 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:42.262562 4040 raft_consensus.cc:3060] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.267472 4007 raft_consensus.cc:740] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.236191 4256 leader_election.cc:290] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:42.268611 4007 consensus_queue.cc:260] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:42.270455 3704 leader_election.cc:343] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.260416 4345 raft_consensus.cc:515] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.275708 4006 raft_consensus.cc:359] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.280419 4006 raft_consensus.cc:385] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.280714 4006 raft_consensus.cc:740] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.277544 4010 tablet_bootstrap.cc:654] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.269353 4338 raft_consensus.cc:493] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.285645 4006 consensus_queue.cc:260] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.289685 4007 ts_tablet_manager.cc:1434] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20251215 20:53:42.295199 4006 ts_tablet_manager.cc:1434] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.047s user 0.004s sys 0.003s
W20251215 20:53:42.288486 3703 leader_election.cc:343] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.301090 4007 tablet_bootstrap.cc:492] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:42.290432 4338 raft_consensus.cc:515] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.309994 4007 tablet_bootstrap.cc:654] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.311456 4338 leader_election.cc:290] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:42.312143 3883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.313997 4345 leader_election.cc:290] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:42.303181 3703 leader_election.cc:304] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.318948 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.319190 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "652957cad9bb4393811a50c064710b1f" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.321828 4275 consensus_queue.cc:1048] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:53:42.326452 3778 leader_election.cc:343] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.327692 3809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.330423 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.331038 3735 raft_consensus.cc:2468] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:42.319567 3886 raft_consensus.cc:2468] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:42.332454 4040 raft_consensus.cc:2749] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.333108 4276 raft_consensus.cc:493] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6f1369e205047049f1aa9f78c06c185)
I20251215 20:53:42.333568 4276 raft_consensus.cc:515] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.334036 4006 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
W20251215 20:53:42.336083 3926 leader_election.cc:343] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.337839 4268 consensus_queue.cc:1048] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:42.347982 3851 leader_election.cc:304] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:42.350397 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "652957cad9bb4393811a50c064710b1f" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:42.350999 3961 raft_consensus.cc:2468] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:42.353039 3779 leader_election.cc:304] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.360740 4005 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: No bootstrap required, opened a new log
I20251215 20:53:42.361196 4005 ts_tablet_manager.cc:1403] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.199s user 0.017s sys 0.008s
I20251215 20:53:42.324644 4338 raft_consensus.cc:2749] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.365549 4005 raft_consensus.cc:359] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.366228 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.369073 3927 leader_election.cc:304] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
W20251215 20:53:42.370256 3927 leader_election.cc:343] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.370813 3927 leader_election.cc:304] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.366149 4005 raft_consensus.cc:385] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.377501 4005 raft_consensus.cc:740] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.378093 4005 consensus_queue.cc:260] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
W20251215 20:53:42.369890 3704 leader_election.cc:343] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.379976 4058 consensus_queue.cc:1048] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:42.380451 4006 tablet_bootstrap.cc:654] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.380764 4040 raft_consensus.cc:2804] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:42.381374 4345 raft_consensus.cc:493] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.387524 4190 raft_consensus.cc:2804] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:42.402865 4016 raft_consensus.cc:493] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.403506 4334 raft_consensus.cc:2749] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.401728 4040 raft_consensus.cc:493] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 20:53:42.405546 3853 consensus_peers.cc:597] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:42.393496 4199 consensus_queue.cc:1048] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20251215 20:53:42.392745 4178 raft_consensus.cc:493] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.395537 4165 raft_consensus.cc:2804] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:42.407164 4190 raft_consensus.cc:493] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:42.424103 4010 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:42.410368 4040 raft_consensus.cc:3060] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.411137 4016 raft_consensus.cc:515] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.437400 3633 catalog_manager.cc:5654] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 0 to 1, leader changed from <none> to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 1 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:42.406718 4349 consensus_queue.cc:1048] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20251215 20:53:42.387661 4330 raft_consensus.cc:515] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.414819 4165 raft_consensus.cc:493] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:42.427026 4190 raft_consensus.cc:3060] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.406893 4345 raft_consensus.cc:515] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.414850 4178 raft_consensus.cc:515] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.428493 4355 consensus_queue.cc:1048] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:42.438081 4016 leader_election.cc:290] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
W20251215 20:53:42.455008 3704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:42341, user_credentials={real_user=slave}} blocked reactor thread for 46565.7us
W20251215 20:53:42.409507 3926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:45041, user_credentials={real_user=slave}} blocked reactor thread for 72306us
W20251215 20:53:42.448025 3703 consensus_peers.cc:597] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:42.449775 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:42.464723 3811 raft_consensus.cc:2393] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:42.465876 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.450830 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.470770 3734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.451975 4178 leader_election.cc:290] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:42.446136 4165 raft_consensus.cc:3060] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.424672 4010 ts_tablet_manager.cc:1403] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.159s user 0.014s sys 0.005s
I20251215 20:53:42.432066 4276 leader_election.cc:290] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:42.460254 4005 ts_tablet_manager.cc:1434] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.099s user 0.006s sys 0.000s
I20251215 20:53:42.452463 4345 leader_election.cc:290] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
W20251215 20:53:42.474890 3704 leader_election.cc:343] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.448063 3813 raft_consensus.cc:3060] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.483407 4010 raft_consensus.cc:359] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.484050 4010 raft_consensus.cc:385] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.486158 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92aa097b972542fe997003b6178e7e41" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:42.489949 4010 raft_consensus.cc:740] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
W20251215 20:53:42.497176 3927 consensus_peers.cc:597] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:42.494724 4010 consensus_queue.cc:260] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.502601 4007 tablet_bootstrap.cc:492] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:42.503082 4007 ts_tablet_manager.cc:1403] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.202s user 0.008s sys 0.034s
I20251215 20:53:42.510212 4330 leader_election.cc:290] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:42.515319 3881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:42.515852 3703 leader_election.cc:343] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.518371 4006 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:42.519078 4006 ts_tablet_manager.cc:1403] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.185s user 0.018s sys 0.020s
I20251215 20:53:42.525504 4010 ts_tablet_manager.cc:1434] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.049s user 0.006s sys 0.000s
I20251215 20:53:42.527464 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.535841 4010 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:42.536427 3737 raft_consensus.cc:2468] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:42.539426 4007 raft_consensus.cc:359] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:42.540110 4007 raft_consensus.cc:385] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.540606 4007 raft_consensus.cc:740] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.541139 4007 consensus_queue.cc:260] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:42.522069 3731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92aa097b972542fe997003b6178e7e41" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.546026 4040 raft_consensus.cc:515] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:42.557405 3881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:42.519343 3703 leader_election.cc:304] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:42.558948 4040 leader_election.cc:290] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:42.567517 3851 leader_election.cc:304] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:42.568420 3851 leader_election.cc:304] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:42.569168 4058 raft_consensus.cc:2804] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:42.569496 4058 raft_consensus.cc:493] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:42.569768 4350 raft_consensus.cc:2749] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:42.569813 4058 raft_consensus.cc:3060] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.571188 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "652957cad9bb4393811a50c064710b1f" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:42.553407 3777 leader_election.cc:304] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:42.584843 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.585453 3811 raft_consensus.cc:2468] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:42.601532 4165 raft_consensus.cc:515] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.602885 3881 raft_consensus.cc:2393] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:42.603721 4165 leader_election.cc:290] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
W20251215 20:53:42.605818 3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45041, user_credentials={real_user=slave}} blocked reactor thread for 89969.8us
I20251215 20:53:42.606295 4190 raft_consensus.cc:515] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
W20251215 20:53:42.606937 3703 leader_election.cc:343] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.607434 3703 leader_election.cc:304] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.608536 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:42.609191 3737 raft_consensus.cc:3060] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.610105 4178 raft_consensus.cc:2749] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.608454 4046 raft_consensus.cc:2749] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.613902 4007 ts_tablet_manager.cc:1434] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.111s user 0.005s sys 0.000s
I20251215 20:53:42.613951 3881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.615023 4007 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:42.620203 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "652957cad9bb4393811a50c064710b1f" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:42.620880 3887 raft_consensus.cc:3060] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:42.607206 3704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:43049, user_credentials={real_user=slave}} blocked reactor thread for 43958.7us
I20251215 20:53:42.638362 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:42.639297 3811 raft_consensus.cc:2393] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:42.639014 4046 consensus_queue.cc:1048] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:42.644930 4006 raft_consensus.cc:359] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.645732 4006 raft_consensus.cc:385] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.646050 4006 raft_consensus.cc:740] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.646817 4006 consensus_queue.cc:260] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.649181 4006 ts_tablet_manager.cc:1434] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.130s user 0.004s sys 0.002s
I20251215 20:53:42.649999 3956 raft_consensus.cc:2393] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:42.651763 4190 leader_election.cc:290] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:42.652400 3884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "652957cad9bb4393811a50c064710b1f" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:42.655750 4058 raft_consensus.cc:515] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.662815 3731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bccb018083644a71b59e3afc68611be2" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:42.668725 4178 consensus_queue.cc:1048] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:53:42.670054 3704 consensus_peers.cc:597] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:42.741883 3704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:43049, user_credentials={real_user=slave}} blocked reactor thread for 71934.7us
I20251215 20:53:42.744088 4355 raft_consensus.cc:493] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.745971 4355 raft_consensus.cc:515] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.748839 3881 raft_consensus.cc:2393] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 230b971d5efa4b3aa8d8f05fc3a3faec in current term 1: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:42.751084 4355 leader_election.cc:290] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:42.722023 4006 tablet_bootstrap.cc:492] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:42.714274 3808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "652957cad9bb4393811a50c064710b1f" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:42.752547 3808 raft_consensus.cc:2393] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:42.746488 4040 raft_consensus.cc:2749] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.751358 3703 leader_election.cc:304] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.758394 4046 raft_consensus.cc:3060] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.763797 4010 tablet_bootstrap.cc:654] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.770521 3887 raft_consensus.cc:2468] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:42.771725 4058 leader_election.cc:290] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:42.773425 3927 leader_election.cc:304] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.718817 3737 raft_consensus.cc:2468] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:42.726753 4007 tablet_bootstrap.cc:654] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.777470 3851 leader_election.cc:304] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:42.789089 4046 raft_consensus.cc:2749] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.792054 3808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a5c0bc6cfd443bb366d645e217dbe7" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.790300 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a5c0bc6cfd443bb366d645e217dbe7" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.794569 3778 leader_election.cc:304] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:42.780448 4165 raft_consensus.cc:2749] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.787287 4190 raft_consensus.cc:2749] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.810256 3777 leader_election.cc:304] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.811347 4040 raft_consensus.cc:2804] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:42.811820 4040 raft_consensus.cc:697] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:42.812582 4040 consensus_queue.cc:237] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
W20251215 20:53:42.823050 3927 leader_election.cc:343] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.823525 4006 tablet_bootstrap.cc:654] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.820744 4330 raft_consensus.cc:2804] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:42.824183 4330 raft_consensus.cc:697] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:42.824981 4330 consensus_queue.cc:237] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.809159 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:42.809266 3738 raft_consensus.cc:2468] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
W20251215 20:53:42.832554 3778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:45041, user_credentials={real_user=slave}} blocked reactor thread for 50186.9us
I20251215 20:53:42.839123 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
W20251215 20:53:42.835134 3703 consensus_peers.cc:597] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:42.846901 3925 leader_election.cc:304] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:42.848845 4190 raft_consensus.cc:2804] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:42.849221 4190 raft_consensus.cc:493] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:42.849525 4190 raft_consensus.cc:3060] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.839803 3810 raft_consensus.cc:3060] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.874029 4099 raft_consensus.cc:493] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.874549 4099 raft_consensus.cc:515] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.874665 3737 raft_consensus.cc:2468] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:42.876936 3810 raft_consensus.cc:2468] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:42.877283 3851 leader_election.cc:304] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:42.877547 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61227fed983e4c8ca9490bf84294f86d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:42.878409 4058 raft_consensus.cc:2804] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:42.878809 4058 raft_consensus.cc:697] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:42.879350 4058 consensus_queue.cc:237] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:42.880327 3704 leader_election.cc:343] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.885593 4099 leader_election.cc:290] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:42.894760 4190 raft_consensus.cc:515] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.897254 4190 leader_election.cc:290] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:42.903010 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61227fed983e4c8ca9490bf84294f86d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.903498 4010 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:42.903973 4010 ts_tablet_manager.cc:1403] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.368s user 0.014s sys 0.008s
I20251215 20:53:42.907045 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a5c0bc6cfd443bb366d645e217dbe7" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
W20251215 20:53:42.910013 3927 leader_election.cc:343] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.910737 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a5c0bc6cfd443bb366d645e217dbe7" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:42.911290 3735 raft_consensus.cc:3060] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:42.912557 3704 leader_election.cc:343] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.913156 3704 leader_election.cc:304] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:42.914206 4046 raft_consensus.cc:2749] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.918828 4010 raft_consensus.cc:359] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.919471 4010 raft_consensus.cc:385] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.919724 4010 raft_consensus.cc:740] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.920351 3735 raft_consensus.cc:2468] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:42.922430 4010 consensus_queue.cc:260] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.926120 3925 leader_election.cc:304] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:42.926936 4190 raft_consensus.cc:2804] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:42.930085 4006 tablet_bootstrap.cc:492] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:42.930490 4006 ts_tablet_manager.cc:1403] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.209s user 0.030s sys 0.016s
I20251215 20:53:42.928035 4190 raft_consensus.cc:697] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:42.937444 4190 consensus_queue.cc:237] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:42.940598 4010 ts_tablet_manager.cc:1434] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.036s user 0.006s sys 0.000s
I20251215 20:53:42.941363 4040 raft_consensus.cc:493] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.941610 4010 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:42.941890 4040 raft_consensus.cc:515] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:42.945173 4040 leader_election.cc:290] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:42.942580 3636 catalog_manager.cc:5654] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:42.947336 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c98269ae53148f29fa1722a088a3c71" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.949222 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c98269ae53148f29fa1722a088a3c71" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.951025 3777 leader_election.cc:304] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:42.951155 3636 catalog_manager.cc:5654] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:42.951709 4040 raft_consensus.cc:2749] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:42.963471 4007 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:42.964401 4007 ts_tablet_manager.cc:1403] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.350s user 0.007s sys 0.019s
I20251215 20:53:42.969141 3812 raft_consensus.cc:3060] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:42.972153 4010 tablet_bootstrap.cc:654] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:42.973974 4007 raft_consensus.cc:359] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.977990 4007 raft_consensus.cc:385] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.978214 4007 raft_consensus.cc:740] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.981849 4007 consensus_queue.cc:260] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.981523 4273 raft_consensus.cc:493] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.984097 4006 raft_consensus.cc:359] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:42.985608 4006 raft_consensus.cc:385] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:42.985900 4006 raft_consensus.cc:740] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:42.987645 4006 consensus_queue.cc:260] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:42.987218 4273 raft_consensus.cc:515] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.991266 4190 raft_consensus.cc:493] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:42.991683 4190 raft_consensus.cc:515] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:42.993846 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b302275303b54dc3a70558581fd3ae49" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.994088 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e9420df6384a1f9822d407d9195e51" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:42.994912 4006 ts_tablet_manager.cc:1434] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.064s user 0.005s sys 0.001s
W20251215 20:53:42.995208 3926 leader_election.cc:343] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.996124 3634 catalog_manager.cc:5654] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:42.996793 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b302275303b54dc3a70558581fd3ae49" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:42.997395 3735 raft_consensus.cc:2468] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:42.998330 3925 leader_election.cc:304] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
W20251215 20:53:42.995318 3927 leader_election.cc:343] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:42.995464 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e9420df6384a1f9822d407d9195e51" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:42.991921 4273 leader_election.cc:290] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:42.999015 4199 raft_consensus.cc:2804] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:42.999413 4199 raft_consensus.cc:493] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:42.999737 4199 raft_consensus.cc:3060] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:53:43.001595 3926 leader_election.cc:343] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:43.002031 3926 leader_election.cc:304] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:43.008603 4273 raft_consensus.cc:2749] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:43.005311 4006 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:43.007369 3632 catalog_manager.cc:5654] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:43.012195 4199 raft_consensus.cc:515] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:42.996021 4007 ts_tablet_manager.cc:1434] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.031s user 0.004s sys 0.002s
I20251215 20:53:43.015159 4007 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:43.016022 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b302275303b54dc3a70558581fd3ae49" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
W20251215 20:53:43.017446 3926 leader_election.cc:343] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:43.021816 4010 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.022287 4010 ts_tablet_manager.cc:1403] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.081s user 0.012s sys 0.013s
I20251215 20:53:43.024000 4010 raft_consensus.cc:359] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.024484 4010 raft_consensus.cc:385] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.024677 4010 raft_consensus.cc:740] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.025182 4010 consensus_queue.cc:260] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.026463 4010 ts_tablet_manager.cc:1434] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251215 20:53:43.027320 4010 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.038146 4010 tablet_bootstrap.cc:654] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.040748 4006 tablet_bootstrap.cc:654] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.043365 4010 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.045825 4010 ts_tablet_manager.cc:1403] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.004s
I20251215 20:53:43.050490 4010 raft_consensus.cc:359] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.051168 4010 raft_consensus.cc:385] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.051427 4010 raft_consensus.cc:740] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.019845 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b302275303b54dc3a70558581fd3ae49" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:43.052858 3735 raft_consensus.cc:3060] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.056384 4199 leader_election.cc:290] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:43.058542 3735 raft_consensus.cc:2468] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:42.996258 4190 leader_election.cc:290] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:43.059767 3925 leader_election.cc:304] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:43.060922 4190 raft_consensus.cc:2804] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:43.062114 4190 raft_consensus.cc:697] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:43.062935 4190 consensus_queue.cc:237] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.052021 4010 consensus_queue.cc:260] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.068271 4010 ts_tablet_manager.cc:1434] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20251215 20:53:43.063470 4007 tablet_bootstrap.cc:654] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.076030 4010 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.083648 4006 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:43.084177 4006 ts_tablet_manager.cc:1403] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.079s user 0.014s sys 0.009s
I20251215 20:53:43.087109 4006 raft_consensus.cc:359] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.087564 4006 raft_consensus.cc:385] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.087760 4006 raft_consensus.cc:740] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.088515 4006 consensus_queue.cc:260] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.091562 4010 tablet_bootstrap.cc:654] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.092034 4006 ts_tablet_manager.cc:1434] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20251215 20:53:43.092533 4007 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:43.093024 4006 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185: Bootstrap starting.
I20251215 20:53:43.093037 4007 ts_tablet_manager.cc:1403] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.078s user 0.010s sys 0.000s
I20251215 20:53:43.095965 4007 raft_consensus.cc:359] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.096717 4007 raft_consensus.cc:385] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.097018 4007 raft_consensus.cc:740] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.097694 4007 consensus_queue.cc:260] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.139159 4006 tablet_bootstrap.cc:654] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.139353 3633 catalog_manager.cc:5654] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:43.167686 4007 ts_tablet_manager.cc:1434] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.074s user 0.005s sys 0.002s
I20251215 20:53:43.205204 4010 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.206123 4010 ts_tablet_manager.cc:1403] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.130s user 0.012s sys 0.004s
I20251215 20:53:43.210772 4010 raft_consensus.cc:359] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.211697 4010 raft_consensus.cc:385] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.212059 4010 raft_consensus.cc:740] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.218818 4006 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185: No bootstrap required, opened a new log
I20251215 20:53:43.220755 4006 ts_tablet_manager.cc:1403] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185: Time spent bootstrapping tablet: real 0.128s user 0.005s sys 0.009s
I20251215 20:53:43.215931 4010 consensus_queue.cc:260] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.221431 3881 raft_consensus.cc:3060] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.223958 4006 raft_consensus.cc:359] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.224848 4006 raft_consensus.cc:385] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.225148 4006 raft_consensus.cc:740] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.225926 4006 consensus_queue.cc:260] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.229552 4006 ts_tablet_manager.cc:1434] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20251215 20:53:43.233551 4007 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:43.235457 4010 ts_tablet_manager.cc:1434] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20251215 20:53:43.238338 4010 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.253123 4007 tablet_bootstrap.cc:654] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.257539 3812 raft_consensus.cc:3060] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.265936 4010 tablet_bootstrap.cc:654] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.274637 3811 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.293123 4007 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:43.293421 4010 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.293833 4007 ts_tablet_manager.cc:1403] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.061s user 0.016s sys 0.010s
I20251215 20:53:43.294068 4010 ts_tablet_manager.cc:1403] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.056s user 0.007s sys 0.005s
I20251215 20:53:43.297171 4007 raft_consensus.cc:359] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.297936 4007 raft_consensus.cc:385] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.298277 4007 raft_consensus.cc:740] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.299189 4007 consensus_queue.cc:260] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.302397 4007 ts_tablet_manager.cc:1434] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20251215 20:53:43.306443 4007 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:43.306084 4010 raft_consensus.cc:359] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.308768 4010 raft_consensus.cc:385] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.309387 4010 raft_consensus.cc:740] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.309938 4010 consensus_queue.cc:260] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.313324 4010 ts_tablet_manager.cc:1434] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.019s user 0.005s sys 0.001s
I20251215 20:53:43.314599 4010 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.323621 4040 raft_consensus.cc:493] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.324203 4040 raft_consensus.cc:515] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.326773 4040 leader_election.cc:290] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:43.332947 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0807745e47db47f7baefd68c4488a72d" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:43.333904 3885 raft_consensus.cc:2468] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:43.337229 4058 consensus_queue.cc:1048] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:43.337872 3734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0807745e47db47f7baefd68c4488a72d" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:43.341127 3734 raft_consensus.cc:2468] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:43.342594 4016 consensus_queue.cc:1048] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 20:53:43.344447 3777 leader_election.cc:304] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:43.345937 4359 raft_consensus.cc:2804] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:43.346333 4359 raft_consensus.cc:493] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:43.346666 4359 raft_consensus.cc:3060] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.359901 4330 consensus_queue.cc:1048] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20251215 20:53:43.374260 4330 consensus_queue.cc:1048] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:43.401341 4007 tablet_bootstrap.cc:654] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:43.390146 3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 45899us
I20251215 20:53:43.414220 4010 tablet_bootstrap.cc:654] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.411680 4359 raft_consensus.cc:515] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.439013 4273 raft_consensus.cc:493] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.442058 4330 consensus_queue.cc:1048] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:43.442663 4273 raft_consensus.cc:515] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.445097 4273 leader_election.cc:290] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
W20251215 20:53:43.448079 3684 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:53:43.448590 4007 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:43.448961 4007 ts_tablet_manager.cc:1403] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.143s user 0.009s sys 0.004s
I20251215 20:53:43.439486 3811 raft_consensus.cc:3060] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.455925 4007 raft_consensus.cc:359] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.457305 4007 raft_consensus.cc:385] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.457787 4007 raft_consensus.cc:740] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.458082 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61227fed983e4c8ca9490bf84294f86d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:43.459553 3737 raft_consensus.cc:2468] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:43.466571 3925 leader_election.cc:304] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:43.467454 4190 raft_consensus.cc:2804] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:43.467792 4190 raft_consensus.cc:493] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:43.468129 4190 raft_consensus.cc:3060] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.459591 4007 consensus_queue.cc:260] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.476203 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61227fed983e4c8ca9490bf84294f86d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:43.477334 4058 consensus_queue.cc:1048] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:43.478525 4007 ts_tablet_manager.cc:1434] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.029s user 0.005s sys 0.000s
I20251215 20:53:43.479574 4007 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
W20251215 20:53:43.479476 3927 leader_election.cc:343] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:43.491577 4007 tablet_bootstrap.cc:654] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.494657 4359 leader_election.cc:290] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:43.495169 3881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0807745e47db47f7baefd68c4488a72d" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:43.498253 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0807745e47db47f7baefd68c4488a72d" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:43.512596 3881 raft_consensus.cc:3060] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.512712 3735 raft_consensus.cc:3060] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.502713 4190 raft_consensus.cc:515] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.504078 4273 consensus_queue.cc:1048] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:43.519502 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61227fed983e4c8ca9490bf84294f86d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
W20251215 20:53:43.521755 3927 leader_election.cc:343] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:43.528823 3881 raft_consensus.cc:2468] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:43.509923 4010 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.530751 4010 ts_tablet_manager.cc:1403] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.216s user 0.019s sys 0.026s
I20251215 20:53:43.532783 3778 leader_election.cc:304] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:43.521397 4190 leader_election.cc:290] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:43.540666 4016 raft_consensus.cc:2804] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:43.541491 4016 raft_consensus.cc:697] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:43.555055 4016 consensus_queue.cc:237] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.567376 4010 raft_consensus.cc:359] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.568058 4010 raft_consensus.cc:385] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.568753 4010 raft_consensus.cc:740] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.571007 4010 consensus_queue.cc:260] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.535050 3734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61227fed983e4c8ca9490bf84294f86d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:43.573139 3734 raft_consensus.cc:3060] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.573580 4007 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:43.574043 4007 ts_tablet_manager.cc:1403] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.095s user 0.019s sys 0.011s
I20251215 20:53:43.577708 4007 raft_consensus.cc:359] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.578344 4007 raft_consensus.cc:385] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.580459 4007 raft_consensus.cc:740] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.581118 4007 consensus_queue.cc:260] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:43.581873 4403 log.cc:927] Time spent T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53: Append to log took a long time: real 0.062s user 0.001s sys 0.000s
I20251215 20:53:43.584069 4007 ts_tablet_manager.cc:1434] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.010s user 0.005s sys 0.001s
I20251215 20:53:43.589573 4007 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:43.591447 4010 ts_tablet_manager.cc:1434] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.060s user 0.006s sys 0.001s
I20251215 20:53:43.598400 4007 tablet_bootstrap.cc:654] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.601171 4010 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.602203 3735 raft_consensus.cc:2468] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:43.607731 3734 raft_consensus.cc:2468] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:43.625456 3632 catalog_manager.cc:5654] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:43.629423 3926 consensus_peers.cc:597] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:43.631316 4007 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:43.631892 4007 ts_tablet_manager.cc:1403] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.043s user 0.011s sys 0.014s
I20251215 20:53:43.634362 4007 raft_consensus.cc:359] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.635062 4007 raft_consensus.cc:385] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.635371 4007 raft_consensus.cc:740] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.636554 4007 consensus_queue.cc:260] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.610950 3925 leader_election.cc:304] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:43.637809 4408 raft_consensus.cc:2804] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:43.638270 4408 raft_consensus.cc:697] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:43.638772 4007 ts_tablet_manager.cc:1434] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:53:43.639575 4007 tablet_bootstrap.cc:492] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:43.639084 4408 consensus_queue.cc:237] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.645650 4007 tablet_bootstrap.cc:654] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.651932 4010 tablet_bootstrap.cc:654] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.657203 4355 consensus_queue.cc:1048] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:43.661392 4273 consensus_queue.cc:1048] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:43.663990 4165 raft_consensus.cc:493] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.664568 4165 raft_consensus.cc:515] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.666833 4165 leader_election.cc:290] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:43.668305 4408 raft_consensus.cc:493] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.668391 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:43.668825 4408 raft_consensus.cc:515] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.671619 3881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:43.672806 3926 leader_election.cc:343] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:43.673749 4408 leader_election.cc:290] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:43.679203 3632 catalog_manager.cc:5654] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:43.684602 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:43.686058 4007 tablet_bootstrap.cc:492] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:43.686585 4007 ts_tablet_manager.cc:1403] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.047s user 0.013s sys 0.008s
I20251215 20:53:43.686856 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:43.687556 3738 raft_consensus.cc:2468] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 0.
I20251215 20:53:43.689342 3853 leader_election.cc:304] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:43.690044 4165 raft_consensus.cc:2749] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:43.690694 4007 raft_consensus.cc:359] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.691529 4007 raft_consensus.cc:385] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.691886 4007 raft_consensus.cc:740] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.692970 4007 consensus_queue.cc:260] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.691275 3925 leader_election.cc:304] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:43.698750 4355 raft_consensus.cc:2804] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:43.699127 4355 raft_consensus.cc:493] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:43.699429 4355 raft_consensus.cc:3060] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.705960 4010 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.705828 4016 raft_consensus.cc:493] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.706545 4010 ts_tablet_manager.cc:1403] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.106s user 0.010s sys 0.002s
I20251215 20:53:43.706457 4016 raft_consensus.cc:515] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.707331 4007 ts_tablet_manager.cc:1434] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20251215 20:53:43.708361 4016 leader_election.cc:290] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:43.708935 4007 tablet_bootstrap.cc:492] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:43.709704 4010 raft_consensus.cc:359] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.710368 4010 raft_consensus.cc:385] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.710626 4010 raft_consensus.cc:740] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.711231 4010 consensus_queue.cc:260] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.713376 4355 raft_consensus.cc:515] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.716249 4007 tablet_bootstrap.cc:654] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.717113 3881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:43.718416 3881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "723425b3ad41419c9207bc5880db1c1c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:43.718649 3926 leader_election.cc:343] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:43.718971 3881 raft_consensus.cc:2468] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:43.722357 4010 ts_tablet_manager.cc:1434] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20251215 20:53:43.723440 4010 tablet_bootstrap.cc:492] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.725669 3778 leader_election.cc:304] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:43.728055 4007 tablet_bootstrap.cc:492] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:43.728561 4007 ts_tablet_manager.cc:1403] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.009s
I20251215 20:53:43.728894 4016 raft_consensus.cc:2804] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:43.729326 4016 raft_consensus.cc:493] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:43.729657 4016 raft_consensus.cc:3060] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.730006 4010 tablet_bootstrap.cc:654] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.731341 4007 raft_consensus.cc:359] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.732138 4007 raft_consensus.cc:385] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.732467 4007 raft_consensus.cc:740] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.733141 4007 consensus_queue.cc:260] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.735586 4007 ts_tablet_manager.cc:1434] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
I20251215 20:53:43.735597 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "723425b3ad41419c9207bc5880db1c1c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:43.736657 4007 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:43.737542 3738 raft_consensus.cc:2468] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:43.741076 4355 leader_election.cc:290] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:43.742422 4010 tablet_bootstrap.cc:492] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.742902 4010 ts_tablet_manager.cc:1403] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.000s
I20251215 20:53:43.743005 4007 tablet_bootstrap.cc:654] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.745396 4010 raft_consensus.cc:359] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.746011 4010 raft_consensus.cc:385] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.746265 4010 raft_consensus.cc:740] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.747148 4007 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:43.746948 4016 raft_consensus.cc:515] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.747530 4007 ts_tablet_manager.cc:1403] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20251215 20:53:43.747701 4010 consensus_queue.cc:260] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.755591 4165 raft_consensus.cc:493] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.756091 4165 raft_consensus.cc:515] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.757977 4165 leader_election.cc:290] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:43.758548 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:43.759526 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:43.761679 3851 leader_election.cc:304] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:43.762774 4165 raft_consensus.cc:2749] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 20:53:43.772792 3704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:43049, user_credentials={real_user=slave}} blocked reactor thread for 63890us
I20251215 20:53:43.779196 3738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:43.798947 4165 raft_consensus.cc:493] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.799511 4165 raft_consensus.cc:515] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.780766 3738 raft_consensus.cc:3060] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.833213 4165 leader_election.cc:290] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:43.839025 4007 raft_consensus.cc:359] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.839747 4007 raft_consensus.cc:385] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.840030 4007 raft_consensus.cc:740] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.840673 4007 consensus_queue.cc:260] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.841387 4330 raft_consensus.cc:493] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.841833 4330 raft_consensus.cc:515] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.842401 4007 ts_tablet_manager.cc:1434] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.095s user 0.051s sys 0.039s
I20251215 20:53:43.843425 4007 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254: Bootstrap starting.
I20251215 20:53:43.843791 4330 leader_election.cc:290] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:43.840718 3734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "723425b3ad41419c9207bc5880db1c1c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:43.844731 3734 raft_consensus.cc:3060] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.847887 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e9420df6384a1f9822d407d9195e51" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:43.849203 4007 tablet_bootstrap.cc:654] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254: Neither blocks nor log segments found. Creating new log.
W20251215 20:53:43.851496 3853 leader_election.cc:343] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:43.853796 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:43.854552 3956 raft_consensus.cc:2468] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:43.856986 3734 raft_consensus.cc:2468] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:43.858091 3777 leader_election.cc:304] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:43.858758 4359 raft_consensus.cc:2804] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:43.859203 4359 raft_consensus.cc:697] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:43.859331 3779 leader_election.cc:304] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:43.860762 4359 consensus_queue.cc:237] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.862970 4395 raft_consensus.cc:2804] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:43.863415 4395 raft_consensus.cc:493] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:43.863786 4395 raft_consensus.cc:3060] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.870982 4010 ts_tablet_manager.cc:1434] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.128s user 0.005s sys 0.020s
I20251215 20:53:43.870771 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e9420df6384a1f9822d407d9195e51" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:43.871469 3956 raft_consensus.cc:2468] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 0.
I20251215 20:53:43.874819 4010 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.878729 4395 raft_consensus.cc:515] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.844100 4016 leader_election.cc:290] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:43.882992 3853 leader_election.cc:304] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:43.883818 4165 raft_consensus.cc:2804] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:43.884167 4165 raft_consensus.cc:493] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:43.884482 4165 raft_consensus.cc:3060] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.887336 3885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "723425b3ad41419c9207bc5880db1c1c" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:43.888036 3885 raft_consensus.cc:3060] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.890369 4165 raft_consensus.cc:515] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.890934 4010 tablet_bootstrap.cc:654] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.893101 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e9420df6384a1f9822d407d9195e51" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
W20251215 20:53:43.894351 3853 leader_election.cc:343] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:43.895187 4165 leader_election.cc:290] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:43.896260 3885 raft_consensus.cc:2468] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:43.896616 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e9420df6384a1f9822d407d9195e51" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:43.897260 3956 raft_consensus.cc:3060] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.903425 4010 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.903911 4010 ts_tablet_manager.cc:1403] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.001s
I20251215 20:53:43.904922 3956 raft_consensus.cc:2468] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:43.906490 4010 raft_consensus.cc:359] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.907157 4010 raft_consensus.cc:385] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.906060 3853 leader_election.cc:304] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:43.907416 4010 raft_consensus.cc:740] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.908111 4010 consensus_queue.cc:260] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:43.909101 4165 raft_consensus.cc:2804] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:43.910285 4165 raft_consensus.cc:697] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:43.911144 4165 consensus_queue.cc:237] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.918964 3885 raft_consensus.cc:3060] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.919625 4010 ts_tablet_manager.cc:1434] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.015s user 0.005s sys 0.002s
I20251215 20:53:43.920676 4010 tablet_bootstrap.cc:492] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.932000 4395 leader_election.cc:290] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:43.932638 4010 tablet_bootstrap.cc:654] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.937808 4016 raft_consensus.cc:493] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.938360 4016 raft_consensus.cc:515] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.940553 4349 raft_consensus.cc:493] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:43.941071 4349 raft_consensus.cc:515] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:43.941614 4016 leader_election.cc:290] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:43.942590 3734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:43.942775 4010 tablet_bootstrap.cc:492] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.944089 4010 ts_tablet_manager.cc:1403] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.006s
I20251215 20:53:43.944254 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b302275303b54dc3a70558581fd3ae49" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:43.946614 4010 raft_consensus.cc:359] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.947283 4010 raft_consensus.cc:385] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.947540 4010 raft_consensus.cc:740] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.948625 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:43.949352 3882 raft_consensus.cc:2468] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:43.952418 4010 consensus_queue.cc:260] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:43.954104 4010 ts_tablet_manager.cc:1434] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20251215 20:53:43.942988 4349 leader_election.cc:290] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:43.955060 4010 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53: Bootstrap starting.
I20251215 20:53:43.963377 4330 consensus_queue.cc:1048] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:43.964480 4010 tablet_bootstrap.cc:654] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53: Neither blocks nor log segments found. Creating new log.
I20251215 20:53:43.958288 3632 catalog_manager.cc:5654] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:43.953547 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:43.971455 3882 raft_consensus.cc:3060] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.978456 4010 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53: No bootstrap required, opened a new log
I20251215 20:53:43.978915 4010 ts_tablet_manager.cc:1403] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.004s
I20251215 20:53:43.981469 4010 raft_consensus.cc:359] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.982075 4010 raft_consensus.cc:385] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:43.982342 4010 raft_consensus.cc:740] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Initialized, Role: FOLLOWER
I20251215 20:53:43.987944 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:43.988332 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:43.988672 3956 raft_consensus.cc:3060] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:43.989141 4010 consensus_queue.cc:260] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:43.992540 3779 leader_election.cc:304] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:43.994532 4395 raft_consensus.cc:2749] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:43.996975 4010 ts_tablet_manager.cc:1434] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53: Time spent starting tablet: real 0.018s user 0.007s sys 0.001s
I20251215 20:53:43.997694 3956 raft_consensus.cc:2468] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:43.998898 3779 leader_election.cc:304] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:44.001148 4016 raft_consensus.cc:2804] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:44.001900 4016 raft_consensus.cc:697] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:44.005311 4007 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254: No bootstrap required, opened a new log
I20251215 20:53:44.005786 4007 ts_tablet_manager.cc:1403] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254: Time spent bootstrapping tablet: real 0.163s user 0.048s sys 0.052s
I20251215 20:53:44.011237 3737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b302275303b54dc3a70558581fd3ae49" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:44.011453 3738 raft_consensus.cc:2468] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:44.022614 4016 consensus_queue.cc:237] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:44.029247 3887 raft_consensus.cc:3060] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.030941 3851 leader_election.cc:304] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:44.039783 4007 raft_consensus.cc:359] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:44.048226 4007 raft_consensus.cc:385] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:53:44.048537 4007 raft_consensus.cc:740] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Initialized, Role: FOLLOWER
I20251215 20:53:44.056560 3925 leader_election.cc:304] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:44.058676 4007 consensus_queue.cc:260] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:44.062070 4199 raft_consensus.cc:2804] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:44.065810 4199 raft_consensus.cc:697] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:44.066732 4199 consensus_queue.cc:237] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:44.068727 4007 ts_tablet_manager.cc:1434] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254: Time spent starting tablet: real 0.063s user 0.008s sys 0.000s
I20251215 20:53:44.033234 4165 raft_consensus.cc:2749] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:44.139103 4349 raft_consensus.cc:493] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:44.139573 4349 raft_consensus.cc:515] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:44.141525 4349 leader_election.cc:290] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:44.143947 3732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:44.144758 3732 raft_consensus.cc:2393] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 1: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:44.153131 4432 raft_consensus.cc:493] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:44.153602 4432 raft_consensus.cc:515] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:44.155540 4432 leader_election.cc:290] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:44.148218 3882 raft_consensus.cc:2468] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:44.173238 3632 catalog_manager.cc:5654] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:44.204618 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:44.204880 3886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e9420df6384a1f9822d407d9195e51" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:44.208914 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e9420df6384a1f9822d407d9195e51" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:44.209664 3957 raft_consensus.cc:2393] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:44.210287 4431 raft_consensus.cc:493] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:44.210739 4431 raft_consensus.cc:515] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:44.212631 4431 leader_election.cc:290] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:44.183729 4432 consensus_queue.cc:1048] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20251215 20:53:44.219753 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:44.224013 3853 leader_election.cc:304] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:44.219553 3811 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.231608 4410 raft_consensus.cc:3060] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.234174 3632 catalog_manager.cc:5654] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:44.236508 3779 leader_election.cc:304] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:44.240046 4432 raft_consensus.cc:3060] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.237493 3882 raft_consensus.cc:2468] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 0.
I20251215 20:53:44.254065 3812 raft_consensus.cc:3060] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.256095 3878 raft_consensus.cc:3060] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.262929 3778 leader_election.cc:304] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:44.263970 4430 raft_consensus.cc:2804] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:44.264336 4430 raft_consensus.cc:493] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:44.264628 4430 raft_consensus.cc:3060] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.270788 4428 consensus_queue.cc:1048] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:44.275250 4441 consensus_queue.cc:1048] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:44.285447 4432 raft_consensus.cc:2749] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:44.286248 4448 raft_consensus.cc:493] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:44.286796 4448 raft_consensus.cc:515] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:44.294549 4448 leader_election.cc:290] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:44.298511 4430 raft_consensus.cc:515] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:44.300283 3880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:44.300917 3880 raft_consensus.cc:2468] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 0.
I20251215 20:53:44.302261 4430 leader_election.cc:290] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:44.305974 3703 leader_election.cc:304] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:44.307142 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:44.307726 3887 raft_consensus.cc:3060] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.309728 4410 raft_consensus.cc:2749] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:53:44.314810 3887 raft_consensus.cc:2468] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:44.316690 3778 leader_election.cc:304] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:44.316594 4440 consensus_queue.cc:1048] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:53:44.317503 4431 raft_consensus.cc:2804] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:53:44.318059 4431 raft_consensus.cc:697] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:44.318869 4431 consensus_queue.cc:237] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:44.330446 4447 raft_consensus.cc:2804] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:53:44.330874 4447 raft_consensus.cc:493] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:44.331208 4447 raft_consensus.cc:3060] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:53:44.332962 3735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:44.331230 3734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:44.336614 3636 catalog_manager.cc:5654] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:44.342661 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:44.344691 4447 raft_consensus.cc:515] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:44.346477 3735 raft_consensus.cc:2393] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 1: Already voted for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in this term.
I20251215 20:53:44.347600 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:44.348318 3887 raft_consensus.cc:2393] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 230b971d5efa4b3aa8d8f05fc3a3faec in current term 1: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:44.350435 4447 leader_election.cc:290] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:44.354687 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a923d91e17724167884e844da2f5a737" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:44.355755 3704 leader_election.cc:304] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:44.356417 4448 raft_consensus.cc:2749] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:53:44.371477 4428 consensus_queue.cc:1048] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:44.394914 4410 consensus_queue.cc:1048] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:44.425012 4410 consensus_queue.cc:1048] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:44.505649 4016 consensus_queue.cc:1048] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:44.524853 3636 catalog_manager.cc:5654] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
W20251215 20:53:44.530987 3684 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20251215 20:53:44.535646 4456 log.cc:927] Time spent T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20251215 20:53:44.537947 4431 consensus_queue.cc:1048] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 20:53:44.560418 3704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:43049, user_credentials={real_user=slave}} blocked reactor thread for 78628.7us
I20251215 20:53:44.602165 4445 consensus_queue.cc:1048] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:44.622967 4445 consensus_queue.cc:1048] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:44.712445 4016 consensus_queue.cc:1048] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:44.727087 4395 consensus_queue.cc:1048] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:53:46.444181 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
W20251215 20:53:46.452032 3851 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20251215 20:53:46.455406 3851 consensus_peers.cc:597] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.470985 3777 consensus_peers.cc:597] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.479795 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:53:46.480644 426 tablet_replica.cc:333] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.481567 426 raft_consensus.cc:2243] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.482193 426 raft_consensus.cc:2272] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.484279 426 tablet_replica.cc:333] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.485071 426 raft_consensus.cc:2243] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.485551 426 raft_consensus.cc:2272] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.487582 426 tablet_replica.cc:333] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.488322 426 raft_consensus.cc:2243] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.488801 426 raft_consensus.cc:2272] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.490466 426 tablet_replica.cc:333] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.491025 426 raft_consensus.cc:2243] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.491389 426 raft_consensus.cc:2272] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.493718 426 tablet_replica.cc:333] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.494334 426 raft_consensus.cc:2243] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.494750 426 raft_consensus.cc:2272] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.496881 426 tablet_replica.cc:333] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.497686 426 raft_consensus.cc:2243] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.498449 426 raft_consensus.cc:2272] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:46.499038 3851 consensus_peers.cc:597] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.500417 426 tablet_replica.cc:333] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.501011 426 raft_consensus.cc:2243] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.501384 426 raft_consensus.cc:2272] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.503293 426 tablet_replica.cc:333] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.504010 426 raft_consensus.cc:2243] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.504757 426 raft_consensus.cc:2272] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.506464 426 tablet_replica.cc:333] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.506964 426 raft_consensus.cc:2243] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.507613 426 raft_consensus.cc:2272] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.509269 426 tablet_replica.cc:333] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.509771 426 raft_consensus.cc:2243] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.510125 426 raft_consensus.cc:2272] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.512143 426 tablet_replica.cc:333] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.512889 426 raft_consensus.cc:2243] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.513809 426 raft_consensus.cc:2272] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.515657 426 tablet_replica.cc:333] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.516157 426 raft_consensus.cc:2243] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.516553 426 raft_consensus.cc:2272] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.518286 426 tablet_replica.cc:333] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.518779 426 raft_consensus.cc:2243] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.519134 426 raft_consensus.cc:2272] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.520759 426 tablet_replica.cc:333] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.521257 426 raft_consensus.cc:2243] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.521971 426 raft_consensus.cc:2272] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.523916 426 tablet_replica.cc:333] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.524725 426 raft_consensus.cc:2243] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.525475 426 raft_consensus.cc:2272] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.527119 426 tablet_replica.cc:333] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.527616 426 raft_consensus.cc:2243] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.528071 426 raft_consensus.cc:2272] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.530403 426 tablet_replica.cc:333] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
W20251215 20:53:46.530921 3777 consensus_peers.cc:597] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.531047 426 raft_consensus.cc:2243] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.531527 426 raft_consensus.cc:2272] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.533166 426 tablet_replica.cc:333] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.533654 426 raft_consensus.cc:2243] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.534337 426 raft_consensus.cc:2272] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.535890 426 tablet_replica.cc:333] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.536405 426 raft_consensus.cc:2243] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.536840 426 raft_consensus.cc:2272] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.538808 426 tablet_replica.cc:333] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.539364 426 raft_consensus.cc:2243] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
W20251215 20:53:46.539479 3851 consensus_peers.cc:597] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.539880 426 raft_consensus.cc:2272] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.541728 426 tablet_replica.cc:333] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.542374 426 raft_consensus.cc:2243] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.542796 426 raft_consensus.cc:2272] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.544955 426 tablet_replica.cc:333] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.545464 426 raft_consensus.cc:2243] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.545920 426 raft_consensus.cc:2272] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.548321 426 tablet_replica.cc:333] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.549100 426 raft_consensus.cc:2243] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
W20251215 20:53:46.549165 3925 consensus_peers.cc:597] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.549602 426 raft_consensus.cc:2272] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:46.551311 3925 consensus_peers.cc:597] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.551908 426 tablet_replica.cc:333] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.552660 426 raft_consensus.cc:2243] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
W20251215 20:53:46.552886 3777 consensus_peers.cc:597] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.553577 426 raft_consensus.cc:2272] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.555913 426 tablet_replica.cc:333] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.556490 426 raft_consensus.cc:2243] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.556831 426 raft_consensus.cc:2272] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.558596 426 tablet_replica.cc:333] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.559271 426 raft_consensus.cc:2243] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.559698 426 raft_consensus.cc:2272] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:46.561758 3777 consensus_peers.cc:597] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.562036 426 tablet_replica.cc:333] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.562760 426 raft_consensus.cc:2243] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
W20251215 20:53:46.562903 3925 consensus_peers.cc:597] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.563298 426 raft_consensus.cc:2272] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.565344 426 tablet_replica.cc:333] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.566031 426 raft_consensus.cc:2243] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.567001 426 raft_consensus.cc:2272] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.569058 426 tablet_replica.cc:333] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.569550 426 raft_consensus.cc:2243] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.569865 426 raft_consensus.cc:2272] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.571336 426 tablet_replica.cc:333] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.571779 426 raft_consensus.cc:2243] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.572455 426 raft_consensus.cc:2272] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.574221 426 tablet_replica.cc:333] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.574685 426 raft_consensus.cc:2243] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.575021 426 raft_consensus.cc:2272] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.576653 426 tablet_replica.cc:333] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.577184 426 raft_consensus.cc:2243] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.577508 426 raft_consensus.cc:2272] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.579419 426 tablet_replica.cc:333] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.579974 426 raft_consensus.cc:2243] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.580374 426 raft_consensus.cc:2272] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.582495 426 tablet_replica.cc:333] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.582953 426 raft_consensus.cc:2243] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.583377 426 raft_consensus.cc:2272] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.585448 426 tablet_replica.cc:333] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.586104 426 raft_consensus.cc:2243] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.586619 426 raft_consensus.cc:2272] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.588910 426 tablet_replica.cc:333] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.589625 426 raft_consensus.cc:2243] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.590574 426 raft_consensus.cc:2272] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.592984 426 tablet_replica.cc:333] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.593665 426 raft_consensus.cc:2243] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.594589 426 raft_consensus.cc:2272] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.596916 426 tablet_replica.cc:333] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.597604 426 raft_consensus.cc:2243] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.598465 426 raft_consensus.cc:2272] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.600832 426 tablet_replica.cc:333] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.601511 426 raft_consensus.cc:2243] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.601977 426 raft_consensus.cc:2272] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:46.603318 3925 consensus_peers.cc:597] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.604054 3851 consensus_peers.cc:597] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.604212 426 tablet_replica.cc:333] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.605007 426 raft_consensus.cc:2243] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.605516 426 raft_consensus.cc:2272] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:46.607746 3925 consensus_peers.cc:597] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.608248 426 tablet_replica.cc:333] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.608927 426 raft_consensus.cc:2243] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.609803 426 raft_consensus.cc:2272] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.612993 426 tablet_replica.cc:333] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.613647 426 raft_consensus.cc:2243] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.614668 426 raft_consensus.cc:2272] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:46.614698 3851 consensus_peers.cc:597] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.616827 426 tablet_replica.cc:333] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.617287 426 raft_consensus.cc:2243] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:53:46.617933 426 raft_consensus.cc:2272] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.619695 426 tablet_replica.cc:333] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.620108 426 raft_consensus.cc:2243] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.620486 426 raft_consensus.cc:2272] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:53:46.622219 426 tablet_replica.cc:333] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: stopping tablet replica
I20251215 20:53:46.622642 426 raft_consensus.cc:2243] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:53:46.623003 426 raft_consensus.cc:2272] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:53:46.645812 3777 consensus_peers.cc:597] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.667757 3925 consensus_peers.cc:597] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.678292 3702 connection.cc:441] server connection from 127.0.0.1:56738 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56738 (request call id 124) could send its response
W20251215 20:53:46.679199 3925 consensus_peers.cc:597] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.679113 3777 consensus_peers.cc:597] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: recv got EOF from 127.0.106.129:40559 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.685949 3777 consensus_peers.cc:597] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.695058 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20251215 20:53:46.734494 3925 consensus_peers.cc:597] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.738859 3925 consensus_peers.cc:597] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.763228 3925 consensus_peers.cc:597] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.767625 3925 consensus_peers.cc:597] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.774062 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:53:46.780514 4482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:46.781661 4483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:53:46.782912 4485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:53:46.783435 426 server_base.cc:1047] running on GCE node
I20251215 20:53:46.785481 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:53:46.785699 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:53:46.785884 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832026785870 us; error 0 us; skew 500 ppm
I20251215 20:53:46.786355 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:53:46.789386 426 webserver.cc:492] Webserver started at http://127.0.106.129:45215/ using document root <none> and password file <none>
I20251215 20:53:46.789882 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:53:46.790060 426 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251215 20:53:46.793284 426 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20251215 20:53:46.799942 4490 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:53:46.800704 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
W20251215 20:53:46.800815 3925 consensus_peers.cc:597] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.801086 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root
uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
format_stamp: "Formatted at 2025-12-15 20:53:35 on dist-test-slave-xp5d"
I20251215 20:53:46.801595 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1765831869714107-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20251215 20:53:46.811956 3925 consensus_peers.cc:597] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:46.816771 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:53:46.817914 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:53:46.819190 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:53:46.823830 4497 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20251215 20:53:46.840157 3925 consensus_peers.cc:597] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.855314 3925 consensus_peers.cc:597] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.871640 3925 consensus_peers.cc:597] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.897284 3777 consensus_peers.cc:597] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:46.924039 3851 consensus_peers.cc:597] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:47.038765 426 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20251215 20:53:47.039142 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.216s user 0.008s sys 0.000s
I20251215 20:53:47.039510 426 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20251215 20:53:47.045248 4497 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.059561 4497 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.060237 4497 tablet_bootstrap.cc:492] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.060751 4497 ts_tablet_manager.cc:1403] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20251215 20:53:47.062449 4497 raft_consensus.cc:359] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.062919 4497 raft_consensus.cc:740] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.063428 4497 consensus_queue.cc:260] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.065562 4497 ts_tablet_manager.cc:1434] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:47.066211 4497 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.079769 4497 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.080780 4497 tablet_bootstrap.cc:492] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.081779 4497 ts_tablet_manager.cc:1403] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.002s
I20251215 20:53:47.084103 4497 raft_consensus.cc:359] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.084930 4497 raft_consensus.cc:740] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.085758 4497 consensus_queue.cc:260] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.087957 4497 ts_tablet_manager.cc:1434] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20251215 20:53:47.088749 4497 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.125241 4497 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.126524 4497 tablet_bootstrap.cc:492] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.127344 4497 ts_tablet_manager.cc:1403] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.023s
I20251215 20:53:47.130235 4497 raft_consensus.cc:359] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.130710 4497 raft_consensus.cc:740] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.131186 4497 consensus_queue.cc:260] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.132551 4497 ts_tablet_manager.cc:1434] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:47.133097 4497 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.171780 4497 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.172652 4497 tablet_bootstrap.cc:492] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.173449 4497 ts_tablet_manager.cc:1403] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.028s
I20251215 20:53:47.175310 4497 raft_consensus.cc:359] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.175925 4497 raft_consensus.cc:740] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.176558 4497 consensus_queue.cc:260] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.178375 4497 ts_tablet_manager.cc:1434] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20251215 20:53:47.179049 4497 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.189874 4497 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.190478 4497 tablet_bootstrap.cc:492] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.190982 4497 ts_tablet_manager.cc:1403] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20251215 20:53:47.192759 4497 raft_consensus.cc:359] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.193326 4497 raft_consensus.cc:740] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.193858 4497 consensus_queue.cc:260] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.195566 4497 ts_tablet_manager.cc:1434] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s
I20251215 20:53:47.196177 4497 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.210790 4497 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.211607 4497 tablet_bootstrap.cc:492] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.212155 4497 ts_tablet_manager.cc:1403] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20251215 20:53:47.214282 4497 raft_consensus.cc:359] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.214907 4497 raft_consensus.cc:740] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.215579 4497 consensus_queue.cc:260] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.217689 4497 ts_tablet_manager.cc:1434] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:47.218375 4497 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.231747 4497 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.232673 4497 tablet_bootstrap.cc:492] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.233552 4497 ts_tablet_manager.cc:1403] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.015s user 0.014s sys 0.000s
I20251215 20:53:47.235644 4497 raft_consensus.cc:359] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.236330 4497 raft_consensus.cc:740] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.237048 4497 consensus_queue.cc:260] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.240566 4497 ts_tablet_manager.cc:1434] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:53:47.241295 4497 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.258821 4497 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.259660 4497 tablet_bootstrap.cc:492] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.260207 4497 ts_tablet_manager.cc:1403] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.004s
I20251215 20:53:47.262570 4497 raft_consensus.cc:359] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.263195 4497 raft_consensus.cc:740] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.263777 4497 consensus_queue.cc:260] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.265686 4497 ts_tablet_manager.cc:1434] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:47.266404 4497 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.283272 4497 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.283986 4497 tablet_bootstrap.cc:492] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.284483 4497 ts_tablet_manager.cc:1403] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.004s
I20251215 20:53:47.286013 4497 raft_consensus.cc:359] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.286459 4497 raft_consensus.cc:740] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.286950 4497 consensus_queue.cc:260] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.288240 4497 ts_tablet_manager.cc:1434] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20251215 20:53:47.288833 4497 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.294674 426 ts_tablet_manager.cc:616] Registered 45 tablets
I20251215 20:53:47.294970 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.255s user 0.203s sys 0.000s
I20251215 20:53:47.304137 4497 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.305006 4497 tablet_bootstrap.cc:492] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.305550 4497 ts_tablet_manager.cc:1403] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.004s
I20251215 20:53:47.307686 4497 raft_consensus.cc:359] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.308312 4497 raft_consensus.cc:740] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.308894 4497 consensus_queue.cc:260] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.310837 4497 ts_tablet_manager.cc:1434] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:47.311546 4497 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.324374 4497 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.325163 4497 tablet_bootstrap.cc:492] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.325728 4497 ts_tablet_manager.cc:1403] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20251215 20:53:47.328625 4497 raft_consensus.cc:359] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.329238 4497 raft_consensus.cc:740] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.329851 4497 consensus_queue.cc:260] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.331929 4497 ts_tablet_manager.cc:1434] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 20:53:47.332723 4497 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.347015 4497 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.347785 4497 tablet_bootstrap.cc:492] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.348345 4497 ts_tablet_manager.cc:1403] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.016s user 0.015s sys 0.000s
I20251215 20:53:47.350489 4497 raft_consensus.cc:359] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.351100 4497 raft_consensus.cc:740] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.351794 4497 consensus_queue.cc:260] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.353979 4497 ts_tablet_manager.cc:1434] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:47.354677 4497 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.366930 4497 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.367571 4497 tablet_bootstrap.cc:492] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.368016 4497 ts_tablet_manager.cc:1403] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20251215 20:53:47.369683 4497 raft_consensus.cc:359] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.370137 4497 raft_consensus.cc:740] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.370639 4497 consensus_queue.cc:260] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.372104 4497 ts_tablet_manager.cc:1434] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20251215 20:53:47.372700 4497 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.384514 4497 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.386180 4497 tablet_bootstrap.cc:492] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.386745 4497 ts_tablet_manager.cc:1403] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20251215 20:53:47.388960 4497 raft_consensus.cc:359] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.389580 4497 raft_consensus.cc:740] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.390065 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:40559
I20251215 20:53:47.390173 4575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:40559 every 8 connection(s)
I20251215 20:53:47.390295 4497 consensus_queue.cc:260] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.392433 4497 ts_tablet_manager.cc:1434] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20251215 20:53:47.393154 4497 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.407908 4497 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.408746 4497 tablet_bootstrap.cc:492] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.409300 4497 ts_tablet_manager.cc:1403] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.001s
I20251215 20:53:47.412442 4497 raft_consensus.cc:359] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.413089 4497 raft_consensus.cc:740] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.413734 4497 consensus_queue.cc:260] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.415362 4497 ts_tablet_manager.cc:1434] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 20:53:47.415587 4576 heartbeater.cc:344] Connected to a master server at 127.0.106.190:35753
I20251215 20:53:47.415956 4576 heartbeater.cc:461] Registering TS with master...
I20251215 20:53:47.415963 4497 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.416651 4576 heartbeater.cc:507] Master 127.0.106.190:35753 requested a full tablet report, sending...
I20251215 20:53:47.441790 4497 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.442658 4497 tablet_bootstrap.cc:492] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.443187 4497 ts_tablet_manager.cc:1403] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.012s
I20251215 20:53:47.445046 4497 raft_consensus.cc:359] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.445848 4497 raft_consensus.cc:740] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.446501 4497 consensus_queue.cc:260] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.448683 4497 ts_tablet_manager.cc:1434] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20251215 20:53:47.449405 4497 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.450430 3632 ts_manager.cc:194] Re-registered known tserver with Master: 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.453126 4445 raft_consensus.cc:493] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.453598 4445 raft_consensus.cc:515] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.455191 4445 leader_election.cc:290] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.456462 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:47.465507 4497 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.466391 4497 tablet_bootstrap.cc:492] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.466972 4497 ts_tablet_manager.cc:1403] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.004s
I20251215 20:53:47.469388 4497 raft_consensus.cc:359] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.469594 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.470053 4497 raft_consensus.cc:740] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.470726 4497 consensus_queue.cc:260] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.471328 4547 raft_consensus.cc:2468] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:47.472622 4497 ts_tablet_manager.cc:1434] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20251215 20:53:47.472569 3925 leader_election.cc:304] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:47.473528 4497 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.473706 4445 raft_consensus.cc:2804] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.474030 4445 raft_consensus.cc:493] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.474330 4445 raft_consensus.cc:3060] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.480563 4445 raft_consensus.cc:515] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.482611 4445 leader_election.cc:290] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.482889 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:47.483650 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.484251 4549 raft_consensus.cc:3060] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.491633 4497 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.492265 4497 tablet_bootstrap.cc:492] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.492734 4497 ts_tablet_manager.cc:1403] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20251215 20:53:47.493850 4549 raft_consensus.cc:2468] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:47.494459 4497 raft_consensus.cc:359] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.495019 4497 raft_consensus.cc:740] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.494843 3925 leader_election.cc:304] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:47.495577 4497 consensus_queue.cc:260] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.495899 4445 raft_consensus.cc:2804] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:47.496390 4445 raft_consensus.cc:697] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:47.497025 4497 ts_tablet_manager.cc:1434] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251215 20:53:47.497602 4497 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.497139 4445 consensus_queue.cc:237] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.499768 3632 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44694
I20251215 20:53:47.504266 4576 heartbeater.cc:499] Master 127.0.106.190:35753 was elected leader, sending a full tablet report...
I20251215 20:53:47.506022 4500 raft_consensus.cc:493] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.506500 4500 raft_consensus.cc:515] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.508224 4500 leader_election.cc:290] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.508766 3632 catalog_manager.cc:5654] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:47.509877 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.510726 4497 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.511530 4497 tablet_bootstrap.cc:492] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.511533 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:47.511888 3925 leader_election.cc:343] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.512332 4497 ts_tablet_manager.cc:1403] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.004s
I20251215 20:53:47.513442 3926 leader_election.cc:304] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:47.514595 4497 raft_consensus.cc:359] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.515223 4497 raft_consensus.cc:740] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.515830 4509 raft_consensus.cc:2749] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:47.515820 4497 consensus_queue.cc:260] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.519198 4497 ts_tablet_manager.cc:1434] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251215 20:53:47.519951 4497 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.527396 4499 raft_consensus.cc:493] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.527897 4499 raft_consensus.cc:515] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.529815 4499 leader_election.cc:290] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.531461 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:47.533668 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
W20251215 20:53:47.534862 3777 leader_election.cc:343] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.535244 3777 leader_election.cc:304] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:47.536187 4499 raft_consensus.cc:2749] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:47.537259 4501 raft_consensus.cc:493] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.537793 4501 raft_consensus.cc:515] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.539669 4501 leader_election.cc:290] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.540190 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:47.541427 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
W20251215 20:53:47.542804 3851 leader_election.cc:343] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.543215 3851 leader_election.cc:304] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:47.543754 4501 raft_consensus.cc:2749] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:47.547333 4497 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.548269 4497 tablet_bootstrap.cc:492] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.548949 4497 ts_tablet_manager.cc:1403] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.015s
I20251215 20:53:47.550742 4497 raft_consensus.cc:359] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.551177 4497 raft_consensus.cc:740] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.551690 4497 consensus_queue.cc:260] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.554641 4497 ts_tablet_manager.cc:1434] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:47.555368 4497 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.566341 4497 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.567157 4497 tablet_bootstrap.cc:492] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.567592 4497 ts_tablet_manager.cc:1403] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20251215 20:53:47.569345 4497 raft_consensus.cc:359] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.569761 4497 raft_consensus.cc:740] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.570299 4497 consensus_queue.cc:260] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.571683 4497 ts_tablet_manager.cc:1434] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 20:53:47.572220 4497 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.582350 4497 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.583060 4497 tablet_bootstrap.cc:492] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.583559 4497 ts_tablet_manager.cc:1403] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.011s user 0.011s sys 0.000s
I20251215 20:53:47.585534 4497 raft_consensus.cc:359] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.586125 4497 raft_consensus.cc:740] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.586719 4497 consensus_queue.cc:260] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.588208 4497 ts_tablet_manager.cc:1434] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 20:53:47.588888 4497 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.597806 4501 raft_consensus.cc:493] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.598299 4501 raft_consensus.cc:515] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.600777 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:47.601032 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.601394 4497 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.602303 4497 tablet_bootstrap.cc:492] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
W20251215 20:53:47.602339 3851 leader_election.cc:343] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.602392 4501 leader_election.cc:290] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.602981 4497 ts_tablet_manager.cc:1403] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.007s
I20251215 20:53:47.602941 3851 leader_election.cc:304] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:47.603677 4501 raft_consensus.cc:2749] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:47.605242 4497 raft_consensus.cc:359] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.605919 4497 raft_consensus.cc:740] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.606566 4497 consensus_queue.cc:260] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.608542 4497 ts_tablet_manager.cc:1434] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20251215 20:53:47.611347 4497 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.615301 4499 raft_consensus.cc:493] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.615790 4499 raft_consensus.cc:515] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.617658 4499 leader_election.cc:290] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:47.618115 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.618508 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:47.619100 3777 leader_election.cc:343] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.619800 3778 leader_election.cc:304] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:47.620345 4499 raft_consensus.cc:2749] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:47.622498 4497 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.623109 4497 tablet_bootstrap.cc:492] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.623550 4497 ts_tablet_manager.cc:1403] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20251215 20:53:47.625205 4497 raft_consensus.cc:359] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.625633 4497 raft_consensus.cc:740] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.626109 4497 consensus_queue.cc:260] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.627483 4497 ts_tablet_manager.cc:1434] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251215 20:53:47.628306 4497 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.639976 4497 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.640790 4497 tablet_bootstrap.cc:492] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.641372 4497 ts_tablet_manager.cc:1403] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.003s
I20251215 20:53:47.643450 4497 raft_consensus.cc:359] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.644054 4497 raft_consensus.cc:740] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.644865 4499 raft_consensus.cc:493] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.644667 4497 consensus_queue.cc:260] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.645372 4499 raft_consensus.cc:515] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.648034 4497 ts_tablet_manager.cc:1434] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:47.648209 4499 leader_election.cc:290] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:47.648432 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:47.648852 4497 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.649101 3882 raft_consensus.cc:2468] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:47.650121 3778 leader_election.cc:304] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:47.650897 4499 raft_consensus.cc:2804] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.651276 4499 raft_consensus.cc:493] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.651612 4501 raft_consensus.cc:493] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.651684 4499 raft_consensus.cc:3060] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.648563 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.653630 4549 raft_consensus.cc:2468] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:47.662709 4499 raft_consensus.cc:515] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.669450 4499 leader_election.cc:290] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:47.670224 3883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:47.670799 3883 raft_consensus.cc:3060] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.673069 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78e2caf38d18407d85cdbfa8a8230a76" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.673677 4547 raft_consensus.cc:3060] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.680542 4547 raft_consensus.cc:2468] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:53:47.681962 3777 leader_election.cc:304] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:47.683060 4499 raft_consensus.cc:2804] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:47.684206 4499 raft_consensus.cc:697] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:47.690909 4501 raft_consensus.cc:515] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.692871 4472 raft_consensus.cc:493] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.693410 4472 raft_consensus.cc:515] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.695102 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:47.695398 4472 leader_election.cc:290] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.700819 4500 raft_consensus.cc:493] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.701362 4500 raft_consensus.cc:515] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.685724 4499 consensus_queue.cc:237] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.703974 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.704758 4547 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:47.705699 3851 leader_election.cc:304] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:47.705813 4500 leader_election.cc:290] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.707844 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:47.710944 4472 raft_consensus.cc:2804] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.711400 4472 raft_consensus.cc:493] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.728685 4472 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.715988 4501 leader_election.cc:290] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.721853 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.725850 4548 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.733851 4548 raft_consensus.cc:2468] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:47.728034 3878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:47.715358 4445 raft_consensus.cc:493] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.735668 4445 raft_consensus.cc:515] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.737711 4445 leader_election.cc:290] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.740458 4497 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.741386 4497 tablet_bootstrap.cc:492] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.742048 4497 ts_tablet_manager.cc:1403] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.093s user 0.037s sys 0.024s
I20251215 20:53:47.742637 3883 raft_consensus.cc:2468] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:53:47.744448 4497 raft_consensus.cc:359] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.745155 4497 raft_consensus.cc:740] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.745817 4497 consensus_queue.cc:260] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.747222 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.748016 4549 raft_consensus.cc:2468] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:47.748003 4497 ts_tablet_manager.cc:1434] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:53:47.749739 4497 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
W20251215 20:53:47.749768 3925 leader_election.cc:343] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.750022 3632 catalog_manager.cc:5654] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:47.751255 3925 leader_election.cc:304] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:47.752012 4500 raft_consensus.cc:2804] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.752398 4500 raft_consensus.cc:493] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.752414 4502 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.752867 4500 raft_consensus.cc:3060] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.753120 4502 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.755592 4502 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.756569 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.757294 3926 leader_election.cc:304] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:47.758000 4445 raft_consensus.cc:2749] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 20:53:47.758524 3777 leader_election.cc:343] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.763401 4497 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.764056 4497 tablet_bootstrap.cc:492] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.764587 4497 ts_tablet_manager.cc:1403] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20251215 20:53:47.765364 3851 leader_election.cc:304] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:47.765970 4599 raft_consensus.cc:2804] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.766322 4599 raft_consensus.cc:493] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.766714 4599 raft_consensus.cc:3060] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.766542 4497 raft_consensus.cc:359] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.767244 4497 raft_consensus.cc:740] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:47.767884 4497 consensus_queue.cc:260] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.769403 4497 ts_tablet_manager.cc:1434] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:47.769948 4497 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:47.775007 4599 raft_consensus.cc:515] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.776806 3878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:47.778272 4499 raft_consensus.cc:493] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.778785 4499 raft_consensus.cc:515] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.780820 4499 leader_election.cc:290] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.781985 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.782672 4549 raft_consensus.cc:2468] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:47.783177 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:47.784101 3777 leader_election.cc:304] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
W20251215 20:53:47.784662 3927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:43049, user_credentials={real_user=slave}} blocked reactor thread for 59984.5us
I20251215 20:53:47.785773 4499 raft_consensus.cc:2804] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.786170 4499 raft_consensus.cc:493] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.786536 4499 raft_consensus.cc:3060] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.789508 4501 raft_consensus.cc:493] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.790021 4501 raft_consensus.cc:515] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.791567 4502 raft_consensus.cc:493] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.792112 4502 raft_consensus.cc:515] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.792587 4409 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.793088 4409 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.794456 4502 leader_election.cc:290] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:47.794946 4409 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.794792 4499 raft_consensus.cc:515] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.796530 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:47.797113 3959 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:47.791944 4501 leader_election.cc:290] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.799047 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.800477 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:47.800633 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.801244 4546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.801959 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:47.802497 3812 raft_consensus.cc:2468] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:47.802748 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:47.803637 3853 leader_election.cc:304] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:47.804905 4548 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.805047 4501 raft_consensus.cc:2804] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.805464 4548 raft_consensus.cc:3060] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
W20251215 20:53:47.805742 3925 leader_election.cc:343] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.805836 4602 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.806354 4602 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.807225 4502 raft_consensus.cc:493] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.807623 4445 raft_consensus.cc:493] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.807727 4502 raft_consensus.cc:515] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.808091 4445 raft_consensus.cc:515] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.808785 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:47.809374 3812 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:47.809670 4502 leader_election.cc:290] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.809619 4445 leader_election.cc:290] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.805523 4501 raft_consensus.cc:493] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.810694 4501 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.811424 4546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.797931 4599 leader_election.cc:290] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.812109 4546 raft_consensus.cc:2468] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:47.813817 3777 leader_election.cc:304] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:47.814478 4502 raft_consensus.cc:2804] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.810133 4549 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:47.815876 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.811822 4499 leader_election.cc:290] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.816557 4547 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:47.817742 3777 leader_election.cc:304] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:47.818598 3925 leader_election.cc:304] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:47.819268 4445 raft_consensus.cc:2804] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.819031 4501 raft_consensus.cc:515] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.819628 4445 raft_consensus.cc:493] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.819958 4445 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.820585 3878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
W20251215 20:53:47.822245 3851 leader_election.cc:343] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.814953 4502 raft_consensus.cc:493] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.824316 4479 raft_consensus.cc:2804] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.824553 3779 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:47.814392 4546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.824756 4479 raft_consensus.cc:493] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.825660 4479 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.825582 4546 raft_consensus.cc:3060] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.828086 4605 raft_consensus.cc:2804] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.828490 4605 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.828625 4445 raft_consensus.cc:515] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.829816 4605 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.830219 4445 leader_election.cc:290] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.831894 4442 raft_consensus.cc:493] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.823585 4502 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.832419 4442 raft_consensus.cc:515] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.834751 4442 leader_election.cc:290] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.836206 3959 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:47.836989 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.837450 4547 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.837919 4605 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.839782 4605 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.834452 4479 raft_consensus.cc:515] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.845875 4445 raft_consensus.cc:493] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.843672 3927 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:47.846271 4445 raft_consensus.cc:515] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.848419 3883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:47.850342 4445 leader_election.cc:290] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.772125 4472 raft_consensus.cc:515] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.844024 4479 leader_election.cc:290] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:47.858532 4545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.849783 4409 raft_consensus.cc:2804] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.859215 4409 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.859195 3878 raft_consensus.cc:2393] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 2: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:47.859828 4409 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.858851 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:47.862129 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:47.859582 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:47.858703 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:47.859251 4545 raft_consensus.cc:2468] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:47.863427 3813 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.867334 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:47.867895 3925 leader_election.cc:304] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:47.868618 4545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.869293 4545 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:47.863503 4543 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:47.870468 4543 raft_consensus.cc:2468] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:47.872099 3925 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:47.872500 4545 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.872970 4509 raft_consensus.cc:2804] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.873378 4509 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.873739 4509 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.862797 3957 raft_consensus.cc:2468] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:47.874495 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.872810 4544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.875959 4544 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.877259 3851 leader_election.cc:304] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:47.877427 4409 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.878567 3956 raft_consensus.cc:2393] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 2: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:47.880980 4599 raft_consensus.cc:2804] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:47.881422 4599 raft_consensus.cc:493] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.881810 4599 raft_consensus.cc:3060] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.884099 4445 raft_consensus.cc:2804] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251215 20:53:47.883673 3851 leader_election.cc:343] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.885766 3813 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:47.843631 4502 raft_consensus.cc:515] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.888527 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:47.889096 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:47.889374 3812 raft_consensus.cc:2393] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 2: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:47.881006 4409 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.897459 4445 raft_consensus.cc:493] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.884931 4544 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
W20251215 20:53:47.889767 3777 leader_election.cc:343] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:47.917253 4445 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.885342 4602 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.914800 4501 leader_election.cc:290] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.919775 3927 leader_election.cc:304] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:47.919800 4546 raft_consensus.cc:2468] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:53:47.931227 4599 raft_consensus.cc:515] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.936810 3777 leader_election.cc:304] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:47.939723 4607 raft_consensus.cc:2804] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:47.940636 4445 raft_consensus.cc:515] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.949425 3810 raft_consensus.cc:2393] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 2: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:47.950104 4445 leader_election.cc:290] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.950806 4502 leader_election.cc:290] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.952490 3779 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
W20251215 20:53:47.953658 3779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:42341, user_credentials={real_user=slave}} blocked reactor thread for 63242us
I20251215 20:53:47.955749 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:47.956382 3812 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.925909 4409 raft_consensus.cc:493] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.959645 4497 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:47.933941 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.953630 4479 raft_consensus.cc:2749] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:53:47.968039 4497 tablet_bootstrap.cc:492] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:47.963729 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:47.927564 4509 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.971622 4497 ts_tablet_manager.cc:1403] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.202s user 0.043s sys 0.045s
I20251215 20:53:47.952980 4547 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:47.973218 3956 raft_consensus.cc:2393] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 2: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:47.940260 4607 raft_consensus.cc:697] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:47.978771 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:47.979245 4607 consensus_queue.cc:237] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.979756 4442 raft_consensus.cc:493] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.963753 4606 raft_consensus.cc:2804] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:47.986164 4445 raft_consensus.cc:493] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.986100 4442 raft_consensus.cc:515] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.986552 4606 raft_consensus.cc:697] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:47.986757 4445 raft_consensus.cc:515] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:47.987435 4606 consensus_queue.cc:237] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:47.988740 4544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.989365 4544 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:47.965890 4472 leader_election.cc:290] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.981885 3812 raft_consensus.cc:2468] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 2.
I20251215 20:53:47.981917 3777 leader_election.cc:304] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:47.977491 4546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:47.984632 3810 raft_consensus.cc:2393] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 2: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:47.963189 4409 raft_consensus.cc:515] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:47.968533 4605 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.990926 3813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:47.990015 4445 leader_election.cc:290] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:47.978286 4500 raft_consensus.cc:515] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.011539 4472 raft_consensus.cc:493] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:48.012010 4545 raft_consensus.cc:1275] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.012629 3959 raft_consensus.cc:2393] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 2: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:47.988225 4442 leader_election.cc:290] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.974267 4548 raft_consensus.cc:2468] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 2.
I20251215 20:53:48.013517 4599 leader_election.cc:290] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:47.986231 4601 raft_consensus.cc:493] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:47.989740 4542 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:48.005182 4497 raft_consensus.cc:359] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:48.017795 4497 raft_consensus.cc:740] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.018605 4497 consensus_queue.cc:260] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:48.020113 4617 raft_consensus.cc:2804] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.020318 4497 ts_tablet_manager.cc:1434] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.048s user 0.005s sys 0.000s
I20251215 20:53:48.012055 4472 raft_consensus.cc:515] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.013432 4605 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.022981 3851 leader_election.cc:304] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:48.023144 4472 leader_election.cc:290] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.023691 4605 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.023850 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:48.024462 4549 raft_consensus.cc:3060] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.026239 4611 raft_consensus.cc:493] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:48.026754 4611 raft_consensus.cc:515] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.028415 4546 raft_consensus.cc:2393] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 2: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:48.028582 4472 raft_consensus.cc:2804] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.021628 4601 raft_consensus.cc:515] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.029315 4472 raft_consensus.cc:697] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:48.030558 4409 leader_election.cc:290] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
W20251215 20:53:48.054767 3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 72938.4us
I20251215 20:53:48.056609 3853 leader_election.cc:304] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:48.058529 3853 leader_election.cc:304] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:48.031395 4601 leader_election.cc:290] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.055912 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.021087 4617 raft_consensus.cc:697] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:48.028604 4611 leader_election.cc:290] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.061697 4442 raft_consensus.cc:2804] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.066175 4599 raft_consensus.cc:2749] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:53:48.031392 4472 consensus_queue.cc:237] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
W20251215 20:53:48.075906 3925 leader_election.cc:343] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:48.078429 3925 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:48.076613 4618 raft_consensus.cc:493] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:48.068959 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:48.081789 3925 leader_election.cc:304] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:48.081952 4409 raft_consensus.cc:2749] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:53:48.082715 4445 consensus_queue.cc:1048] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.088245 3887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:48.084962 3880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:48.091358 3880 raft_consensus.cc:2393] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 2: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:48.085170 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254" is_pre_election: true
I20251215 20:53:48.085517 4542 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.086537 4497 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.093130 3878 raft_consensus.cc:3060] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.095260 4549 raft_consensus.cc:2468] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 2.
I20251215 20:53:48.073220 4500 leader_election.cc:290] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.084641 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:48.096709 3810 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:48.098457 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9f1dde6ceb14bfd881708502fbbc307" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:48.101161 4616 raft_consensus.cc:2749] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:53:48.089779 3887 raft_consensus.cc:2468] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:48.079249 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:48.104573 3961 raft_consensus.cc:2468] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:48.107265 4509 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:48.107774 4547 raft_consensus.cc:2393] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 2: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:48.089105 4612 raft_consensus.cc:493] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:48.121999 3957 raft_consensus.cc:2393] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36692678524d48f8b2e8cc240e9ce254 in current term 2: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:48.121992 3812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:48.129423 3812 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.124490 3927 leader_election.cc:304] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:48.132149 3853 leader_election.cc:304] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:48.087453 4618 raft_consensus.cc:515] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.161298 4409 raft_consensus.cc:2804] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:48.162669 4409 raft_consensus.cc:493] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:48.163033 4409 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.104499 4617 consensus_queue.cc:237] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.160740 4612 raft_consensus.cc:515] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.171808 4612 leader_election.cc:290] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:48.117558 4544 raft_consensus.cc:2468] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:53:48.173507 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:48.163784 4501 raft_consensus.cc:2804] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251215 20:53:48.177480 3851 leader_election.cc:343] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:48.173676 4618 leader_election.cc:290] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.174945 3632 catalog_manager.cc:5654] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.176779 3926 leader_election.cc:304] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:48.179443 3851 leader_election.cc:304] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:48.185475 3812 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:48.186430 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:48.191684 4602 raft_consensus.cc:2804] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:48.198167 4602 raft_consensus.cc:493] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:48.198508 4602 raft_consensus.cc:3060] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.200168 4609 raft_consensus.cc:2804] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.200053 3633 catalog_manager.cc:5654] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.180045 4501 raft_consensus.cc:493] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:48.202144 4501 raft_consensus.cc:3060] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.193706 3961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:48.204931 3961 raft_consensus.cc:2468] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 1.
I20251215 20:53:48.205912 3853 leader_election.cc:304] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:48.206670 4621 raft_consensus.cc:2804] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:53:48.207011 4621 raft_consensus.cc:493] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 230b971d5efa4b3aa8d8f05fc3a3faec)
I20251215 20:53:48.207326 4621 raft_consensus.cc:3060] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.200752 4609 raft_consensus.cc:697] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:48.209647 4609 consensus_queue.cc:237] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.192840 3927 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:48.210695 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185" is_pre_election: true
I20251215 20:53:48.211454 3956 raft_consensus.cc:2393] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 2: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:48.180351 3878 raft_consensus.cc:1275] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.177086 4442 raft_consensus.cc:697] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:48.213351 4442 consensus_queue.cc:237] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:48.219406 4409 raft_consensus.cc:515] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.221727 4409 leader_election.cc:290] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:48.220921 4612 raft_consensus.cc:2804] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.223338 4612 raft_consensus.cc:697] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:48.224152 4501 raft_consensus.cc:515] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.225442 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:48.225962 3810 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.249605 3851 leader_election.cc:304] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:48.250998 4409 consensus_queue.cc:1048] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.244323 3958 raft_consensus.cc:2393] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in current term 2: Already voted for candidate b6f1369e205047049f1aa9f78c06c185 in this term.
I20251215 20:53:48.257294 4501 leader_election.cc:290] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.257730 3634 catalog_manager.cc:5654] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:48.260422 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:48.261016 3956 raft_consensus.cc:3060] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.269380 3633 catalog_manager.cc:5654] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.271162 3633 catalog_manager.cc:5654] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:48.272413 3956 raft_consensus.cc:2468] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 2.
I20251215 20:53:48.273489 4621 raft_consensus.cc:515] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.273783 3810 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:48.275113 4602 raft_consensus.cc:515] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.275439 4621 leader_election.cc:290] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.273505 3853 leader_election.cc:304] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:48.224125 4612 consensus_queue.cc:237] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.284343 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.284703 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.284950 4549 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:48.285380 4547 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 1.
I20251215 20:53:48.295218 4542 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.295918 4542 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:48.297422 4497 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.298276 4497 tablet_bootstrap.cc:492] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.301985 3927 leader_election.cc:304] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:48.302889 4500 raft_consensus.cc:2804] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.303588 4500 raft_consensus.cc:697] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:48.310065 4497 ts_tablet_manager.cc:1403] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.224s user 0.011s sys 0.012s
I20251215 20:53:48.310196 4500 consensus_queue.cc:237] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.314252 4497 raft_consensus.cc:359] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.317353 4497 raft_consensus.cc:740] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.318038 4497 consensus_queue.cc:260] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.321806 4497 ts_tablet_manager.cc:1434] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.011s user 0.004s sys 0.001s
I20251215 20:53:48.322604 4497 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.331053 3633 catalog_manager.cc:5654] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.335511 4544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d37236082954925b36d02b68cbd3a0f" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.336331 4544 raft_consensus.cc:2393] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 2: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:48.338609 4544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.339964 4544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:48.340526 4544 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.344985 4542 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4e98056a2e24e4a9381fc3ee9451a8e" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:48.345893 4542 raft_consensus.cc:2393] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 2: Already voted for candidate 36692678524d48f8b2e8cc240e9ce254 in this term.
I20251215 20:53:48.349664 4497 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.350625 4497 tablet_bootstrap.cc:492] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.351236 4497 ts_tablet_manager.cc:1403] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.007s
I20251215 20:53:48.352061 4602 leader_election.cc:290] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559)
I20251215 20:53:48.359792 4497 raft_consensus.cc:359] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.360488 4497 raft_consensus.cc:740] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.362656 4544 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:48.363441 4497 consensus_queue.cc:260] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.366641 4497 ts_tablet_manager.cc:1434] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20251215 20:53:48.367329 4497 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.382057 4442 raft_consensus.cc:2749] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:48.382598 4497 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20251215 20:53:48.382176 3851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:40559, user_credentials={real_user=slave}} blocked reactor thread for 132630us
I20251215 20:53:48.382947 4549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b16d8c675f4f6580bf11876ac11bfd" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.383411 4497 tablet_bootstrap.cc:492] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.383759 4549 raft_consensus.cc:2393] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6f1369e205047049f1aa9f78c06c185 in current term 2: Already voted for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in this term.
I20251215 20:53:48.384119 4497 ts_tablet_manager.cc:1403] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.004s
I20251215 20:53:48.385182 4544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:48.385743 4544 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.386504 4497 raft_consensus.cc:359] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.387130 4497 raft_consensus.cc:740] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.387833 4497 consensus_queue.cc:260] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
W20251215 20:53:48.389211 3853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:42341, user_credentials={real_user=slave}} blocked reactor thread for 115770us
I20251215 20:53:48.391028 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:48.391564 3956 raft_consensus.cc:3060] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.392598 4544 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:48.396792 3777 leader_election.cc:304] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:48.396785 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:48.397586 4619 raft_consensus.cc:2804] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.398171 4619 raft_consensus.cc:697] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:48.391044 4621 raft_consensus.cc:2804] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.398591 3777 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:48.398769 4621 raft_consensus.cc:697] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:48.399058 4619 consensus_queue.cc:237] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.399834 4610 raft_consensus.cc:2764] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20251215 20:53:48.401657 3925 leader_election.cc:304] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:48.402420 4497 ts_tablet_manager.cc:1434] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
W20251215 20:53:48.402699 3925 leader_election.cc:343] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:48.403191 4497 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.401628 3777 leader_election.cc:304] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters: b6f1369e205047049f1aa9f78c06c185
I20251215 20:53:48.404449 4479 raft_consensus.cc:2764] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20251215 20:53:48.407781 3956 raft_consensus.cc:2468] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 2.
I20251215 20:53:48.408507 4621 consensus_queue.cc:237] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.410190 4544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:48.413149 4544 raft_consensus.cc:1275] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.403646 3925 leader_election.cc:304] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:48.415074 4612 raft_consensus.cc:3060] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.420454 4605 consensus_queue.cc:1048] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.422235 4497 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.418859 4602 raft_consensus.cc:2749] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:53:48.423902 3925 leader_election.cc:304] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6f1369e205047049f1aa9f78c06c185; no voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:48.424790 4614 raft_consensus.cc:3060] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.432106 4614 raft_consensus.cc:2749] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:48.432178 4497 tablet_bootstrap.cc:492] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.433292 4497 ts_tablet_manager.cc:1403] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.030s user 0.014s sys 0.003s
I20251215 20:53:48.439164 4612 raft_consensus.cc:2749] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:53:48.440536 3883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9214cecd3f6d4af381064ccde6023020" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:48.440438 4497 raft_consensus.cc:359] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:48.441125 4497 raft_consensus.cc:740] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.441128 3883 raft_consensus.cc:3060] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.444728 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6f8125d05ac2440d8825d3fffa8fc079" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:48.444710 4497 consensus_queue.cc:260] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
W20251215 20:53:48.446543 3925 leader_election.cc:343] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:48.449643 3853 leader_election.cc:304] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:48.450441 4501 raft_consensus.cc:2804] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.450893 4501 raft_consensus.cc:697] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:48.451673 4501 consensus_queue.cc:237] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.458643 4497 ts_tablet_manager.cc:1434] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.025s user 0.003s sys 0.002s
I20251215 20:53:48.459450 4497 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.460505 4542 raft_consensus.cc:1275] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.456180 3883 raft_consensus.cc:2468] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:48.462003 4479 consensus_queue.cc:1048] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.479974 4547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5f721cb539a4588950f815d7376e735" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:48.490087 3882 raft_consensus.cc:1275] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 20:53:48.492022 3851 leader_election.cc:343] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:48.493242 3851 leader_election.cc:343] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:53:48.493954 3851 leader_election.cc:343] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:53:48.495386 3926 leader_election.cc:304] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters: 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:48.496932 4509 raft_consensus.cc:2804] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:48.497366 4509 raft_consensus.cc:697] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:48.498149 4509 consensus_queue.cc:237] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.500092 3633 catalog_manager.cc:5654] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.500900 3634 catalog_manager.cc:5654] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:48.507231 4619 consensus_queue.cc:1048] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.518383 3883 raft_consensus.cc:1275] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.526304 4502 consensus_queue.cc:1048] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.515493 3632 catalog_manager.cc:5654] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.532088 3632 catalog_manager.cc:5654] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.567430 4497 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.568717 4497 tablet_bootstrap.cc:492] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.569284 4497 ts_tablet_manager.cc:1403] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.110s user 0.031s sys 0.037s
I20251215 20:53:48.571441 4497 raft_consensus.cc:359] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.572052 4497 raft_consensus.cc:740] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.572680 4497 consensus_queue.cc:260] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.575076 4497 ts_tablet_manager.cc:1434] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20251215 20:53:48.575852 4497 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.574438 3634 catalog_manager.cc:5654] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.596704 4497 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.597585 4497 tablet_bootstrap.cc:492] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.598133 4497 ts_tablet_manager.cc:1403] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.003s
I20251215 20:53:48.599730 4497 raft_consensus.cc:359] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.600167 4497 raft_consensus.cc:740] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.600750 4497 consensus_queue.cc:260] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.604820 4497 ts_tablet_manager.cc:1434] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:53:48.605123 4542 raft_consensus.cc:1275] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.606527 4619 consensus_queue.cc:1048] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.608541 4497 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.613299 3956 raft_consensus.cc:1275] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.616014 4619 consensus_queue.cc:1048] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.621865 3633 catalog_manager.cc:5654] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 1 to 2, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:48.631912 4547 raft_consensus.cc:1275] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.639693 4409 consensus_queue.cc:1048] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.646378 3810 raft_consensus.cc:1275] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.648344 4509 consensus_queue.cc:1048] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.650569 4544 raft_consensus.cc:1275] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.654222 4497 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.655109 4497 tablet_bootstrap.cc:492] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.655725 4497 ts_tablet_manager.cc:1403] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.003s
I20251215 20:53:48.658069 4497 raft_consensus.cc:359] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:48.658704 4497 raft_consensus.cc:740] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.659611 4497 consensus_queue.cc:260] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:48.660635 4621 consensus_queue.cc:1048] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.661671 4497 ts_tablet_manager.cc:1434] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.005s sys 0.003s
I20251215 20:53:48.661664 3957 raft_consensus.cc:1275] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.663863 4497 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.665762 4621 consensus_queue.cc:1048] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.688841 3813 raft_consensus.cc:1275] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.690213 4509 consensus_queue.cc:1048] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.708936 4542 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:48.717214 3810 raft_consensus.cc:1275] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.718479 4409 consensus_queue.cc:1048] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.720430 4542 raft_consensus.cc:1275] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.725219 4497 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.726095 4497 tablet_bootstrap.cc:492] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.726701 4497 ts_tablet_manager.cc:1403] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.063s user 0.024s sys 0.006s
I20251215 20:53:48.728892 4497 raft_consensus.cc:359] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.729485 4497 raft_consensus.cc:740] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.730192 4497 consensus_queue.cc:260] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.732266 4497 ts_tablet_manager.cc:1434] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20251215 20:53:48.733026 4497 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.752452 4497 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.753261 4497 tablet_bootstrap.cc:492] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.753819 4497 ts_tablet_manager.cc:1403] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.009s
I20251215 20:53:48.763976 4544 raft_consensus.cc:1275] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.766636 4615 consensus_queue.cc:1048] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.770462 4497 raft_consensus.cc:359] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.771937 4497 raft_consensus.cc:740] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.774466 4621 consensus_queue.cc:1048] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.775267 4497 consensus_queue.cc:260] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.777376 4497 ts_tablet_manager.cc:1434] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20251215 20:53:48.778107 4497 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.789022 3813 raft_consensus.cc:1275] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.792371 4547 raft_consensus.cc:1275] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.795200 4547 raft_consensus.cc:1275] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.795418 4621 consensus_queue.cc:1048] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.801730 4409 consensus_queue.cc:1048] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.802965 4621 consensus_queue.cc:1048] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.820259 3957 raft_consensus.cc:1275] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.822238 4621 consensus_queue.cc:1048] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.845675 3957 raft_consensus.cc:1275] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.849346 4501 consensus_queue.cc:1048] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251215 20:53:48.904340 3851 consensus_peers.cc:597] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:53:48.911746 3925 consensus_peers.cc:597] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:48.912487 4497 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.913419 4497 tablet_bootstrap.cc:492] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.914007 4497 ts_tablet_manager.cc:1403] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.136s user 0.032s sys 0.023s
I20251215 20:53:48.914645 4542 raft_consensus.cc:1275] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.917039 3957 raft_consensus.cc:1275] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.918272 4619 consensus_queue.cc:1048] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251215 20:53:48.920102 3851 consensus_peers.cc:597] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:53:48.920637 4621 consensus_queue.cc:1048] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20251215 20:53:48.919749 4497 raft_consensus.cc:359] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.936834 4497 raft_consensus.cc:740] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.937438 4497 consensus_queue.cc:260] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:48.938198 3957 raft_consensus.cc:1275] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.939510 4497 ts_tablet_manager.cc:1434] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.025s user 0.004s sys 0.000s
I20251215 20:53:48.939746 4502 consensus_queue.cc:1048] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.940459 4497 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:48.944954 3882 raft_consensus.cc:1275] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:48.946200 4612 consensus_queue.cc:1048] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:48.977262 4497 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:48.978147 4497 tablet_bootstrap.cc:492] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:48.978857 4497 ts_tablet_manager.cc:1403] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.039s user 0.016s sys 0.001s
I20251215 20:53:48.981338 4497 raft_consensus.cc:359] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.982216 4497 raft_consensus.cc:740] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:48.983181 4497 consensus_queue.cc:260] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:48.985491 4497 ts_tablet_manager.cc:1434] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20251215 20:53:48.986755 4497 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:49.003268 4497 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:49.004201 4497 tablet_bootstrap.cc:492] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:49.005445 4497 ts_tablet_manager.cc:1403] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.003s
I20251215 20:53:49.007686 4497 raft_consensus.cc:359] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:49.008801 4497 raft_consensus.cc:740] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:49.009375 4497 consensus_queue.cc:260] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:49.012352 4497 ts_tablet_manager.cc:1434] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251215 20:53:49.012946 4497 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:49.026983 4497 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:49.027647 4497 tablet_bootstrap.cc:492] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:49.028115 4497 ts_tablet_manager.cc:1403] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.004s
I20251215 20:53:49.029681 4497 raft_consensus.cc:359] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:49.030136 4497 raft_consensus.cc:740] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:49.030578 4497 consensus_queue.cc:260] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:49.032120 4497 ts_tablet_manager.cc:1434] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20251215 20:53:49.033315 4497 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:49.045347 4497 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:49.046169 4497 tablet_bootstrap.cc:492] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:49.047493 4497 ts_tablet_manager.cc:1403] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20251215 20:53:49.049360 4497 raft_consensus.cc:359] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:49.050002 4497 raft_consensus.cc:740] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:49.050477 4497 consensus_queue.cc:260] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:49.052245 4497 ts_tablet_manager.cc:1434] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20251215 20:53:49.053145 4497 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:49.067549 4497 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:49.068389 4497 tablet_bootstrap.cc:492] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:49.068821 4497 ts_tablet_manager.cc:1403] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.007s
I20251215 20:53:49.070377 4497 raft_consensus.cc:359] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:49.070971 4497 raft_consensus.cc:740] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:49.071522 4497 consensus_queue.cc:260] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:49.073776 4497 ts_tablet_manager.cc:1434] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:53:49.074328 4497 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:49.085348 4497 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:49.085948 4497 tablet_bootstrap.cc:492] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:49.086383 4497 ts_tablet_manager.cc:1403] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20251215 20:53:49.087993 4497 raft_consensus.cc:359] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:49.088469 4497 raft_consensus.cc:740] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:49.089032 4497 consensus_queue.cc:260] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:49.090849 4497 ts_tablet_manager.cc:1434] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251215 20:53:49.092278 4497 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap starting.
I20251215 20:53:49.107861 4497 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 20:53:49.108618 4497 tablet_bootstrap.cc:492] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Bootstrap complete.
I20251215 20:53:49.109174 4497 ts_tablet_manager.cc:1403] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.003s
I20251215 20:53:49.111059 4497 raft_consensus.cc:359] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:49.111617 4497 raft_consensus.cc:740] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Initialized, Role: FOLLOWER
I20251215 20:53:49.112160 4497 consensus_queue.cc:260] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:49.113896 4497 ts_tablet_manager.cc:1434] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251215 20:53:49.328517 4542 raft_consensus.cc:3060] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:49.355034 4542 raft_consensus.cc:3060] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:49.487543 4548 raft_consensus.cc:3060] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:49.842299 4685 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:53:49.842728 4685 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:49.844141 4685 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:49.844874 4542 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" is_pre_election: true
I20251215 20:53:49.844935 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" is_pre_election: true
I20251215 20:53:49.845665 4542 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 1.
I20251215 20:53:49.845723 3810 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 2.
I20251215 20:53:49.846542 3925 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:49.847116 4685 raft_consensus.cc:2804] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:53:49.847380 4685 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:53:49.847620 4685 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:49.853243 4685 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:49.854714 4685 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 3 election: Requested vote from peers 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:49.855443 4542 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
I20251215 20:53:49.855703 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "b6f1369e205047049f1aa9f78c06c185" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:49.855930 4542 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 3
I20251215 20:53:49.856227 3810 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:49.860761 3810 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 3.
I20251215 20:53:49.860790 4542 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f1369e205047049f1aa9f78c06c185 in term 3.
I20251215 20:53:49.861744 3925 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:49.862323 4685 raft_consensus.cc:2804] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:53:49.864116 4685 raft_consensus.cc:697] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 3 LEADER]: Becoming Leader. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:49.865906 4685 consensus_queue.cc:237] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:49.878294 3635 catalog_manager.cc:5654] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 reported cstate change: term changed from 1 to 3, leader changed from 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129) to b6f1369e205047049f1aa9f78c06c185 (127.0.106.132). New cstate: current_term: 3 leader_uuid: "b6f1369e205047049f1aa9f78c06c185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:50.264654 4548 raft_consensus.cc:1275] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:53:50.265834 4686 consensus_queue.cc:1048] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:50.277485 3810 raft_consensus.cc:1275] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Refusing update from remote peer b6f1369e205047049f1aa9f78c06c185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:53:50.278864 4686 consensus_queue.cc:1048] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:57.406823 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:53:57.451905 3956 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "10876eda60774113b16eca9ad870db31"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:57.452502 3956 raft_consensus.cc:606] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:57.461721 3882 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b"
dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:50438
I20251215 20:53:57.462113 3882 raft_consensus.cc:606] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:57.464020 3956 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:57.464409 3956 raft_consensus.cc:606] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Received request to transfer leadership to TS 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:57.474103 3811 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a83049337c094dcb8a7150a796d41592"
dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:44712
I20251215 20:53:57.474572 3811 raft_consensus.cc:606] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:57.477669 3956 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:57.478158 3956 raft_consensus.cc:606] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:57.479077 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20251215 20:53:57.480547 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:53:57.481408 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:53:57.483683 4712 raft_consensus.cc:993] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:57.484359 4709 raft_consensus.cc:1081] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:57.486053 4548 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "10876eda60774113b16eca9ad870db31"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:53:57.486581 4548 raft_consensus.cc:493] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:57.486974 4548 raft_consensus.cc:3060] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:57.502049 4548 raft_consensus.cc:515] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:57.511075 4548 leader_election.cc:290] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:57.521437 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:57.522004 3882 raft_consensus.cc:3060] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:57.529126 3882 raft_consensus.cc:2468] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:53:57.531312 4493 leader_election.cc:304] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:57.535392 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10876eda60774113b16eca9ad870db31" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:57.535962 3956 raft_consensus.cc:3055] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:53:57.536253 3956 raft_consensus.cc:740] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:57.537025 3956 consensus_queue.cc:260] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:57.538293 3956 raft_consensus.cc:3060] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:57.545838 3956 raft_consensus.cc:2468] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:53:57.547076 4721 raft_consensus.cc:2804] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:57.549145 4721 raft_consensus.cc:697] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:57.550022 4721 consensus_queue.cc:237] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } }
I20251215 20:53:57.560981 3635 catalog_manager.cc:5654] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 1 to 2, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 2 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } }
I20251215 20:53:57.601730 4711 raft_consensus.cc:993] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:57.602135 4711 raft_consensus.cc:1081] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:57.603353 4548 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a83049337c094dcb8a7150a796d41592"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43140
I20251215 20:53:57.603724 4548 raft_consensus.cc:493] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:57.603966 4548 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.609205 4548 raft_consensus.cc:515] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:57.610534 4548 leader_election.cc:290] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:57.611305 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:57.611856 3956 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.617260 3956 raft_consensus.cc:2468] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:57.618432 4494 leader_election.cc:304] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:57.619143 4721 raft_consensus.cc:2804] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:53:57.619518 4721 raft_consensus.cc:697] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:57.620558 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a83049337c094dcb8a7150a796d41592" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:57.620383 4721 consensus_queue.cc:237] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:57.621085 3810 raft_consensus.cc:3055] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:53:57.621366 3810 raft_consensus.cc:740] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:57.622027 3810 consensus_queue.cc:260] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:57.623351 3810 raft_consensus.cc:3060] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.627745 4713 raft_consensus.cc:993] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:57.628563 4712 raft_consensus.cc:1081] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:57.629547 3810 raft_consensus.cc:2468] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:57.631569 4547 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:53:57.632052 4547 raft_consensus.cc:493] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:57.632375 4547 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.633541 3635 catalog_manager.cc:5654] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 2 to 3, leader changed from 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 3 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:57.637537 4547 raft_consensus.cc:515] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:57.639001 4547 leader_election.cc:290] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:57.639786 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:57.639879 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1ac152899e2447cb009e0cdcfa8c729" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:57.640374 3810 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.640476 3956 raft_consensus.cc:3055] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:53:57.640856 3956 raft_consensus.cc:740] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:57.641553 3956 consensus_queue.cc:260] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:57.642661 3956 raft_consensus.cc:3060] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.644452 3810 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:57.645364 4494 leader_election.cc:304] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:57.646325 4721 raft_consensus.cc:2804] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:53:57.646773 4721 raft_consensus.cc:697] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:57.647545 4721 consensus_queue.cc:237] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:57.648057 3956 raft_consensus.cc:2468] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:57.657196 3635 catalog_manager.cc:5654] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 2 to 3, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 3 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:57.746992 4699 raft_consensus.cc:993] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:57.747428 4703 raft_consensus.cc:1081] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:57.748528 4547 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43148
I20251215 20:53:57.748924 4547 raft_consensus.cc:493] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:57.749161 4547 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.754714 4547 raft_consensus.cc:515] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:57.755921 4547 leader_election.cc:290] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:57.756534 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:57.756755 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2752ef3d844a1ab4ca11c0d262f78b" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:57.757064 3810 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.757252 3882 raft_consensus.cc:3055] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:53:57.757529 3882 raft_consensus.cc:740] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:57.758088 3882 consensus_queue.cc:260] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:57.758913 3882 raft_consensus.cc:3060] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:57.761323 3810 raft_consensus.cc:2468] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:57.762138 4494 leader_election.cc:304] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:57.762697 4721 raft_consensus.cc:2804] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:53:57.763124 4721 raft_consensus.cc:697] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:57.763988 4721 consensus_queue.cc:237] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:57.766413 3882 raft_consensus.cc:2468] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:57.776968 3635 catalog_manager.cc:5654] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 2 to 3, leader changed from 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 3 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:57.860663 4713 raft_consensus.cc:993] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 039a78b97c7142de8e3a5cb5d3f5bb53 to start an election
I20251215 20:53:57.861213 4729 raft_consensus.cc:1081] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Signalling peer 039a78b97c7142de8e3a5cb5d3f5bb53 to start an election
I20251215 20:53:57.863116 3810 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73"
dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
from {username='slave'} at 127.0.0.1:32818
I20251215 20:53:57.863618 3810 raft_consensus.cc:493] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:57.863942 3810 raft_consensus.cc:3060] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:57.869036 3810 raft_consensus.cc:515] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:57.870728 3810 leader_election.cc:290] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:57.871259 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:57.871497 3956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7eb57a5ba3904de2880d27be51f34c73" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:57.871794 3882 raft_consensus.cc:3060] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:57.871979 3956 raft_consensus.cc:3055] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:53:57.872361 3956 raft_consensus.cc:740] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:57.873037 3956 consensus_queue.cc:260] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:57.873855 3956 raft_consensus.cc:3060] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:57.875887 3882 raft_consensus.cc:2468] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:53:57.876744 3778 leader_election.cc:304] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:57.877473 4718 raft_consensus.cc:2804] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:57.877912 4718 raft_consensus.cc:697] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:57.878623 3956 raft_consensus.cc:2468] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:53:57.878693 4718 consensus_queue.cc:237] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:57.887916 3635 catalog_manager.cc:5654] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 1 to 2, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:58.047228 3956 raft_consensus.cc:1275] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:58.048128 4721 consensus_queue.cc:1048] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:58.056578 3810 raft_consensus.cc:1275] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:58.058681 4721 consensus_queue.cc:1048] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:58.068176 3956 raft_consensus.cc:1275] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:58.070750 3956 raft_consensus.cc:1275] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:58.070713 4722 consensus_queue.cc:1048] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:53:58.073944 4722 consensus_queue.cc:1048] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:58.086493 3878 raft_consensus.cc:1275] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:58.087726 4721 consensus_queue.cc:1048] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:58.100312 3811 raft_consensus.cc:1275] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:58.114523 4741 consensus_queue.cc:1048] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251215 20:53:58.227314 3811 raft_consensus.cc:1275] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:58.228312 4741 consensus_queue.cc:1048] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:58.236054 3878 raft_consensus.cc:1275] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:58.237231 4721 consensus_queue.cc:1048] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:58.466812 3957 raft_consensus.cc:1275] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:58.467866 4718 consensus_queue.cc:1048] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:58.467973 3878 raft_consensus.cc:1275] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:58.469208 4705 consensus_queue.cc:1048] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:58.546676 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:53:58.590369 3957 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:58.590929 3957 raft_consensus.cc:606] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:58.593080 3810 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4"
dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
mode: GRACEFUL
new_leader_uuid: "36692678524d48f8b2e8cc240e9ce254"
from {username='slave'} at 127.0.0.1:44712
I20251215 20:53:58.593528 3810 raft_consensus.cc:606] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Received request to transfer leadership to TS 36692678524d48f8b2e8cc240e9ce254
I20251215 20:53:58.595659 3957 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:58.596042 3957 raft_consensus.cc:606] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:58.597966 3957 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:58.598325 3957 raft_consensus.cc:606] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Received request to transfer leadership to TS 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:53:58.599988 3957 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:58.600364 3957 raft_consensus.cc:606] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:58.601147 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20251215 20:53:58.602138 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:53:58.602610 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:53:58.706050 4713 raft_consensus.cc:993] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:58.706439 4729 raft_consensus.cc:1081] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:58.707597 4548 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:53:58.708005 4548 raft_consensus.cc:493] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:58.708341 4548 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:58.713172 4548 raft_consensus.cc:515] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:58.714586 4548 leader_election.cc:290] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:58.715210 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:58.715520 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff6382eccb248a4a205426da0977b1e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:58.715924 3957 raft_consensus.cc:3055] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:53:58.716097 3810 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:58.716332 3957 raft_consensus.cc:740] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:58.717756 3957 consensus_queue.cc:260] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:58.718744 3957 raft_consensus.cc:3060] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:58.722663 3810 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:58.723695 4494 leader_election.cc:304] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:58.724314 4741 raft_consensus.cc:2804] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:53:58.724748 4741 raft_consensus.cc:697] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:58.725298 3957 raft_consensus.cc:2468] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:58.725639 4741 consensus_queue.cc:237] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:58.734629 3636 catalog_manager.cc:5654] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 2 to 3, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 3 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:58.768779 4713 raft_consensus.cc:993] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:58.769138 4729 raft_consensus.cc:1081] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:58.770278 4548 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:53:58.770661 4548 raft_consensus.cc:493] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:58.770911 4548 raft_consensus.cc:3060] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.776154 4548 raft_consensus.cc:515] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:58.777428 4548 leader_election.cc:290] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:58.778211 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:58.778324 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fa3cc7e66d147f8af03254252cfac85" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:58.778738 3810 raft_consensus.cc:3060] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.778800 3957 raft_consensus.cc:3055] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:53:58.779145 3957 raft_consensus.cc:740] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:58.779726 3957 consensus_queue.cc:260] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:58.780704 3957 raft_consensus.cc:3060] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.783105 3810 raft_consensus.cc:2468] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:53:58.783910 4494 leader_election.cc:304] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:58.784607 4741 raft_consensus.cc:2804] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:58.784965 4741 raft_consensus.cc:697] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:58.785148 3957 raft_consensus.cc:2468] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:53:58.785828 4741 consensus_queue.cc:237] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:58.795120 3636 catalog_manager.cc:5654] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 1 to 2, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 2 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:58.810014 4713 raft_consensus.cc:993] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 039a78b97c7142de8e3a5cb5d3f5bb53 to start an election
I20251215 20:53:58.810408 4729 raft_consensus.cc:1081] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Signalling peer 039a78b97c7142de8e3a5cb5d3f5bb53 to start an election
I20251215 20:53:58.811527 3810 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e"
dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
from {username='slave'} at 127.0.0.1:32818
I20251215 20:53:58.811928 3810 raft_consensus.cc:493] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:58.812239 3810 raft_consensus.cc:3060] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.818291 3810 raft_consensus.cc:515] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:58.821305 3878 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:58.821684 3810 leader_election.cc:290] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:58.821834 3878 raft_consensus.cc:3060] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.828096 3878 raft_consensus.cc:2468] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:53:58.828589 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aab07a1cee7745b88f2372e58ead711e" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:58.829034 3778 leader_election.cc:304] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:58.829138 3957 raft_consensus.cc:3055] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:53:58.829516 3957 raft_consensus.cc:740] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:58.829680 4748 raft_consensus.cc:2804] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:58.830142 4748 raft_consensus.cc:697] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:58.830097 3957 consensus_queue.cc:260] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:58.831161 3957 raft_consensus.cc:3060] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.830914 4748 consensus_queue.cc:237] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:58.836599 3957 raft_consensus.cc:2468] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:53:58.842133 3636 catalog_manager.cc:5654] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 1 to 2, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:58.890365 4748 raft_consensus.cc:993] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53: : Instructing follower 36692678524d48f8b2e8cc240e9ce254 to start an election
I20251215 20:53:58.890821 4718 raft_consensus.cc:1081] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Signalling peer 36692678524d48f8b2e8cc240e9ce254 to start an election
I20251215 20:53:58.891969 3878 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4"
dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
from {username='slave'} at 127.0.0.1:33082
I20251215 20:53:58.892374 3878 raft_consensus.cc:493] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:58.892611 3878 raft_consensus.cc:3060] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.897598 3878 raft_consensus.cc:515] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:58.899621 3878 leader_election.cc:290] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:53:58.900190 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:58.900820 3811 raft_consensus.cc:3055] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:53:58.900707 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "50e3aad815f9468187ec1d605addfcb4" candidate_uuid: "36692678524d48f8b2e8cc240e9ce254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:58.901443 3811 raft_consensus.cc:740] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:53:58.901607 3957 raft_consensus.cc:3060] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.902112 3811 consensus_queue.cc:260] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:58.903007 3811 raft_consensus.cc:3060] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:58.905980 3957 raft_consensus.cc:2468] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 2.
I20251215 20:53:58.906809 3853 leader_election.cc:304] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36692678524d48f8b2e8cc240e9ce254, b6f1369e205047049f1aa9f78c06c185; no voters:
I20251215 20:53:58.907352 4699 raft_consensus.cc:2804] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:58.907616 3811 raft_consensus.cc:2468] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36692678524d48f8b2e8cc240e9ce254 in term 2.
I20251215 20:53:58.907658 4699 raft_consensus.cc:697] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Becoming Leader. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:53:58.908591 4699 consensus_queue.cc:237] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:53:58.919292 3636 catalog_manager.cc:5654] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 reported cstate change: term changed from 1 to 2, leader changed from 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130) to 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "36692678524d48f8b2e8cc240e9ce254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:59.151732 4756 raft_consensus.cc:993] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.152122 4729 raft_consensus.cc:1081] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.153470 4542 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:53:59.153882 4542 raft_consensus.cc:493] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:59.154210 4542 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:59.159781 4542 raft_consensus.cc:515] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:59.161051 4542 leader_election.cc:290] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:53:59.161646 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:59.161916 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2ff03e068e044b29e3c7843b2dbc453" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:53:59.162233 3957 raft_consensus.cc:3055] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:53:59.162415 3882 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:59.162562 3957 raft_consensus.cc:740] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:59.163303 3957 consensus_queue.cc:260] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:59.164403 3957 raft_consensus.cc:3060] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:59.168406 3882 raft_consensus.cc:2468] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:59.169315 4493 leader_election.cc:304] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:53:59.170133 4721 raft_consensus.cc:2804] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:53:59.170575 4721 raft_consensus.cc:697] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:59.171387 4721 consensus_queue.cc:237] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:53:59.170552 3957 raft_consensus.cc:2468] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:59.179605 3636 catalog_manager.cc:5654] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 2 to 3, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 3 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:59.225122 3811 raft_consensus.cc:1275] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:59.226313 4741 consensus_queue.cc:1048] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:59.234441 3957 raft_consensus.cc:1275] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:53:59.236362 4741 consensus_queue.cc:1048] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:53:59.281049 3810 raft_consensus.cc:1275] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:59.281958 4741 consensus_queue.cc:1048] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:59.295650 3957 raft_consensus.cc:1275] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:59.297197 4765 consensus_queue.cc:1048] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:53:59.371452 3957 raft_consensus.cc:1275] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:59.372462 4718 consensus_queue.cc:1048] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:59.380529 3882 raft_consensus.cc:1275] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:59.381817 4748 consensus_queue.cc:1048] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:59.422608 3811 raft_consensus.cc:1275] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:59.423933 4758 consensus_queue.cc:1048] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:59.433844 3957 raft_consensus.cc:1275] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 36692678524d48f8b2e8cc240e9ce254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:53:59.438226 4699 consensus_queue.cc:1048] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:59.637305 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:53:59.671886 3957 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:59.672353 3957 raft_consensus.cc:606] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:59.674611 3957 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:59.675102 3957 raft_consensus.cc:606] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:59.677363 3882 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd"
dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:50438
I20251215 20:53:59.677839 3882 raft_consensus.cc:606] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:59.680054 3957 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:53:59.680444 3957 raft_consensus.cc:606] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:59.682287 3811 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6"
dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:44712
I20251215 20:53:59.682761 3811 raft_consensus.cc:606] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:53:59.683723 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20251215 20:53:59.684031 3957 raft_consensus.cc:1275] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:53:59.685036 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:53:59.685441 4765 consensus_queue.cc:1048] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:59.685751 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:53:59.686003 4756 raft_consensus.cc:993] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.686619 4729 raft_consensus.cc:1081] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.688033 4542 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:53:59.688524 4542 raft_consensus.cc:493] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:59.688834 4542 raft_consensus.cc:3060] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:59.691522 3882 raft_consensus.cc:1275] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:53:59.692879 4765 consensus_queue.cc:1048] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:53:59.707798 4542 raft_consensus.cc:515] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:59.709625 4542 leader_election.cc:290] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:59.712014 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:59.712591 3811 raft_consensus.cc:3060] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:59.714311 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d68c2b110ed41cb96b24e3f1034082a" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:59.715019 3957 raft_consensus.cc:3055] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:53:59.715337 3957 raft_consensus.cc:740] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:59.716001 3957 consensus_queue.cc:260] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:59.717171 3957 raft_consensus.cc:3060] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:59.718017 3811 raft_consensus.cc:2468] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:53:59.718883 4494 leader_election.cc:304] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:59.720553 4741 raft_consensus.cc:2804] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:59.720981 4741 raft_consensus.cc:697] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:59.721828 4741 consensus_queue.cc:237] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:59.736730 3635 catalog_manager.cc:5654] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 1 to 2, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 2 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:59.742769 3957 raft_consensus.cc:2468] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:53:59.958297 4756 raft_consensus.cc:993] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.958889 4773 raft_consensus.cc:1081] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.960242 4542 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:53:59.960789 4542 raft_consensus.cc:493] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:59.961153 4542 raft_consensus.cc:3060] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:59.965940 4542 raft_consensus.cc:515] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:59.967352 4542 leader_election.cc:290] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:59.968483 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:59.968897 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be5be8f0ad8e4eaba735e5da252f993e" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:59.969029 3957 raft_consensus.cc:3055] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:53:59.969420 3811 raft_consensus.cc:3060] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:59.969424 3957 raft_consensus.cc:740] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:59.970573 3957 consensus_queue.cc:260] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:59.972028 3957 raft_consensus.cc:3060] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:53:59.976538 4756 raft_consensus.cc:993] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.976624 3811 raft_consensus.cc:2468] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:53:59.977015 4773 raft_consensus.cc:1081] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.977877 4494 leader_election.cc:304] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:59.978389 3957 raft_consensus.cc:2468] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:53:59.978580 4721 raft_consensus.cc:2804] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:53:59.980607 4721 raft_consensus.cc:697] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:53:59.981067 4542 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:53:59.981528 4542 raft_consensus.cc:493] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:53:59.981396 4721 consensus_queue.cc:237] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:59.981817 4542 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:59.983618 4781 raft_consensus.cc:993] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.984127 4781 raft_consensus.cc:1081] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:53:59.987190 4542 raft_consensus.cc:515] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:59.988447 4542 leader_election.cc:290] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:53:59.989336 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:53:59.989893 3811 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:59.990104 3957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18007ad8f0ba4c649034cc34d9d4991d" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:53:59.990602 3957 raft_consensus.cc:3055] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:53:59.990867 3957 raft_consensus.cc:740] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:53:59.990953 3635 catalog_manager.cc:5654] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 1 to 2, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 2 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:53:59.991609 3957 consensus_queue.cc:260] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:53:59.992659 3957 raft_consensus.cc:3060] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:53:59.996191 3811 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:53:59.997165 4494 leader_election.cc:304] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:53:59.997995 3957 raft_consensus.cc:2468] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:54:00.000103 4542 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43148
I20251215 20:54:00.000654 4542 raft_consensus.cc:493] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:00.001021 4542 raft_consensus.cc:3060] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:00.002337 4721 raft_consensus.cc:2804] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:00.002839 4721 raft_consensus.cc:697] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:54:00.003633 4721 consensus_queue.cc:237] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:54:00.005431 4542 raft_consensus.cc:515] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:00.007086 4542 leader_election.cc:290] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:54:00.007712 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:54:00.008251 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0459c455a09425d8a6db8c7b275dabd" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:54:00.008255 3882 raft_consensus.cc:3055] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:00.008788 3811 raft_consensus.cc:3060] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:00.009004 3882 raft_consensus.cc:740] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36692678524d48f8b2e8cc240e9ce254, State: Running, Role: LEADER
I20251215 20:54:00.009755 3882 consensus_queue.cc:260] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:00.010893 3882 raft_consensus.cc:3060] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:00.013572 3635 catalog_manager.cc:5654] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 2 to 3, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 3 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:00.015230 3811 raft_consensus.cc:2468] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:54:00.016175 4494 leader_election.cc:304] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:54:00.016903 3882 raft_consensus.cc:2468] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:54:00.016932 4721 raft_consensus.cc:2804] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:00.017696 4721 raft_consensus.cc:697] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:54:00.018481 4721 consensus_queue.cc:237] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:00.039001 3635 catalog_manager.cc:5654] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 1 to 2, leader changed from 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 2 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:00.049501 4768 raft_consensus.cc:993] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:54:00.049991 4748 raft_consensus.cc:1081] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:54:00.051270 4542 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43140
I20251215 20:54:00.051743 4542 raft_consensus.cc:493] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:00.052016 4542 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:00.056345 4542 raft_consensus.cc:515] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:00.058085 4542 leader_election.cc:290] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:54:00.058344 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:54:00.058867 3811 raft_consensus.cc:3055] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:00.058881 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6511a4d6d3149b2a8cf9bd821bfbfa6" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:54:00.059154 3811 raft_consensus.cc:740] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:54:00.059507 3882 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:00.059863 3811 consensus_queue.cc:260] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:00.060988 3811 raft_consensus.cc:3060] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:00.064199 3882 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:54:00.065182 4493 leader_election.cc:304] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:54:00.065711 3811 raft_consensus.cc:2468] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 3.
I20251215 20:54:00.065964 4721 raft_consensus.cc:2804] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:00.066444 4721 raft_consensus.cc:697] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:54:00.067183 4721 consensus_queue.cc:237] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:00.075559 3635 catalog_manager.cc:5654] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 2 to 3, leader changed from 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 3 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:00.106458 3811 raft_consensus.cc:1275] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:00.107445 4721 consensus_queue.cc:1048] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:00.116014 3956 raft_consensus.cc:1275] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:00.117161 4741 consensus_queue.cc:1048] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:00.363881 3956 raft_consensus.cc:1275] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:00.365119 4741 consensus_queue.cc:1048] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:00.373276 3811 raft_consensus.cc:1275] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:00.374773 4790 consensus_queue.cc:1048] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:54:00.460804 3878 raft_consensus.cc:1275] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:00.461737 4790 consensus_queue.cc:1048] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:00.469345 3811 raft_consensus.cc:1275] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:00.470513 4765 consensus_queue.cc:1048] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:00.528388 3958 raft_consensus.cc:1275] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:00.530424 4741 consensus_queue.cc:1048] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:00.543511 3811 raft_consensus.cc:1275] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:00.544842 4790 consensus_queue.cc:1048] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:00.590070 3811 raft_consensus.cc:1275] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:00.591019 4790 consensus_queue.cc:1048] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:00.598125 3878 raft_consensus.cc:1275] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:00.599356 4790 consensus_queue.cc:1048] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:00.747761 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:00.782121 3958 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:54:00.782613 3958 raft_consensus.cc:606] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 3 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:54:00.784627 3958 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe"
dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
mode: GRACEFUL
new_leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
from {username='slave'} at 127.0.0.1:36152
I20251215 20:54:00.785092 3958 raft_consensus.cc:606] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Received request to transfer leadership to TS 039a78b97c7142de8e3a5cb5d3f5bb53
I20251215 20:54:00.785912 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251215 20:54:00.786870 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:00.787364 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:00.932152 4756 raft_consensus.cc:993] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 039a78b97c7142de8e3a5cb5d3f5bb53 to start an election
I20251215 20:54:00.932699 4773 raft_consensus.cc:1081] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Signalling peer 039a78b97c7142de8e3a5cb5d3f5bb53 to start an election
I20251215 20:54:00.933908 3811 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe"
dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
from {username='slave'} at 127.0.0.1:32818
I20251215 20:54:00.934307 3811 raft_consensus.cc:493] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:00.934594 3811 raft_consensus.cc:3060] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:00.940339 3811 raft_consensus.cc:515] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:54:00.941613 3811 leader_election.cc:290] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Requested vote from peers 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041), b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341)
I20251215 20:54:00.942188 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:54:00.942343 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b7ca5082d6447b0abc43526a605e3fe" candidate_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:54:00.942626 3882 raft_consensus.cc:3060] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:00.942843 3958 raft_consensus.cc:3055] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:00.947868 3958 raft_consensus.cc:740] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:54:00.948215 3882 raft_consensus.cc:2468] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:54:00.948558 3958 consensus_queue.cc:260] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:54:00.949265 3778 leader_election.cc:304] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:54:00.949793 3958 raft_consensus.cc:3060] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:00.949946 4748 raft_consensus.cc:2804] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:00.950448 4748 raft_consensus.cc:697] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Becoming Leader. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:54:00.951188 4748 consensus_queue.cc:237] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } }
I20251215 20:54:00.955693 3958 raft_consensus.cc:2468] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039a78b97c7142de8e3a5cb5d3f5bb53 in term 2.
I20251215 20:54:00.963279 3635 catalog_manager.cc:5654] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 reported cstate change: term changed from 1 to 2, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:01.064774 4773 raft_consensus.cc:993] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:54:01.065218 4756 raft_consensus.cc:1081] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 3 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:54:01.066565 4542 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43154
I20251215 20:54:01.066955 4542 raft_consensus.cc:493] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:01.067209 4542 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:01.071808 4542 raft_consensus.cc:515] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:54:01.073304 4542 leader_election.cc:290] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 4 election: Requested vote from peers b6f1369e205047049f1aa9f78c06c185 (127.0.106.132:42341), 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049)
I20251215 20:54:01.073755 3958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b6f1369e205047049f1aa9f78c06c185"
I20251215 20:54:01.073995 3811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e812e063f2e49a49186f8a05f18c535" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:54:01.074348 3958 raft_consensus.cc:3055] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:54:01.074512 3811 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:01.074669 3958 raft_consensus.cc:740] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6f1369e205047049f1aa9f78c06c185, State: Running, Role: LEADER
I20251215 20:54:01.075297 3958 consensus_queue.cc:260] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:54:01.075985 3958 raft_consensus.cc:3060] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:01.079403 3811 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 4.
I20251215 20:54:01.080812 4494 leader_election.cc:304] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039a78b97c7142de8e3a5cb5d3f5bb53, 230b971d5efa4b3aa8d8f05fc3a3faec; no voters:
I20251215 20:54:01.081564 4790 raft_consensus.cc:2804] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:54:01.082003 4790 raft_consensus.cc:697] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 4 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:54:01.082798 4790 consensus_queue.cc:237] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } }
I20251215 20:54:01.084794 3958 raft_consensus.cc:2468] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 4.
I20251215 20:54:01.093001 3635 catalog_manager.cc:5654] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 3 to 4, leader changed from b6f1369e205047049f1aa9f78c06c185 (127.0.106.132) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 4 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:01.394474 3878 raft_consensus.cc:1275] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:01.395628 4748 consensus_queue.cc:1048] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:01.407088 3956 raft_consensus.cc:1275] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Refusing update from remote peer 039a78b97c7142de8e3a5cb5d3f5bb53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:01.408542 4768 consensus_queue.cc:1048] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:01.710204 3810 raft_consensus.cc:1275] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 4 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:54:01.711333 4741 consensus_queue.cc:1048] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:01.711941 3958 raft_consensus.cc:1275] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 4 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:54:01.713536 4741 consensus_queue.cc:1048] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f1369e205047049f1aa9f78c06c185" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:01.817181 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:01.849803 3810 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66"
dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
mode: GRACEFUL
new_leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:44712
I20251215 20:54:01.850334 3810 raft_consensus.cc:606] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Received request to transfer leadership to TS 230b971d5efa4b3aa8d8f05fc3a3faec
I20251215 20:54:01.851317 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251215 20:54:01.852442 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:01.852928 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:02.109624 4768 raft_consensus.cc:993] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53: : Instructing follower 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:54:02.110006 4807 raft_consensus.cc:1081] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Signalling peer 230b971d5efa4b3aa8d8f05fc3a3faec to start an election
I20251215 20:54:02.111105 4548 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66"
dest_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec"
from {username='slave'} at 127.0.0.1:43140
I20251215 20:54:02.111508 4548 raft_consensus.cc:493] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:02.111753 4548 raft_consensus.cc:3060] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:02.115692 4548 raft_consensus.cc:515] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:02.117223 4548 leader_election.cc:290] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Requested vote from peers 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049), 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041)
I20251215 20:54:02.117930 3810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53"
I20251215 20:54:02.118505 3810 raft_consensus.cc:3055] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:02.118508 3882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d4826d1ea440588d15aefa34a7be66" candidate_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36692678524d48f8b2e8cc240e9ce254"
I20251215 20:54:02.118839 3810 raft_consensus.cc:740] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 039a78b97c7142de8e3a5cb5d3f5bb53, State: Running, Role: LEADER
I20251215 20:54:02.119360 3882 raft_consensus.cc:3060] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:02.119779 3810 consensus_queue.cc:260] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:02.120675 3810 raft_consensus.cc:3060] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:02.123441 3882 raft_consensus.cc:2468] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:54:02.124436 4493 leader_election.cc:304] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 230b971d5efa4b3aa8d8f05fc3a3faec, 36692678524d48f8b2e8cc240e9ce254; no voters:
I20251215 20:54:02.125023 3810 raft_consensus.cc:2468] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 230b971d5efa4b3aa8d8f05fc3a3faec in term 2.
I20251215 20:54:02.125190 4741 raft_consensus.cc:2804] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:02.125665 4741 raft_consensus.cc:697] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Becoming Leader. State: Replica: 230b971d5efa4b3aa8d8f05fc3a3faec, State: Running, Role: LEADER
I20251215 20:54:02.126506 4741 consensus_queue.cc:237] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } }
I20251215 20:54:02.136163 3632 catalog_manager.cc:5654] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec reported cstate change: term changed from 1 to 2, leader changed from 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130) to 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129). New cstate: current_term: 2 leader_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "230b971d5efa4b3aa8d8f05fc3a3faec" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:02.609580 3811 raft_consensus.cc:1275] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:02.610538 4741 consensus_queue.cc:1048] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "039a78b97c7142de8e3a5cb5d3f5bb53" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:02.621044 3878 raft_consensus.cc:1275] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Refusing update from remote peer 230b971d5efa4b3aa8d8f05fc3a3faec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:02.622267 4741 consensus_queue.cc:1048] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [LEADER]: Connected to new peer: Peer: permanent_uuid: "36692678524d48f8b2e8cc240e9ce254" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:02.885145 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:02.919591 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:02.920455 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:02.920884 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:02.951241 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:02.983577 426 tablet_server.cc:178] TabletServer@127.0.106.129:40559 shutting down...
W20251215 20:54:02.989475 3851 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 58 similar messages]
W20251215 20:54:02.995018 3851 consensus_peers.cc:597] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.018958 3777 consensus_peers.cc:597] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.022809 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:03.023958 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.025063 426 raft_consensus.cc:2243] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.025698 426 raft_consensus.cc:2272] T a923d91e17724167884e844da2f5a737 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.026539 3777 consensus_peers.cc:597] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.027231 3777 consensus_peers.cc:597] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.028941 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.029708 426 raft_consensus.cc:2243] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.030172 426 raft_consensus.cc:2272] T a6ccd6add84b428eb601968b0547c5a6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.030249 3925 consensus_peers.cc:597] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.032670 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.033249 426 raft_consensus.cc:2243] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.033730 426 raft_consensus.cc:2272] T 9214cecd3f6d4af381064ccde6023020 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.036197 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.036888 426 raft_consensus.cc:2243] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.037364 426 raft_consensus.cc:2272] T 4a40f55e64934e3384ce7a7e98833ebc P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.039897 426 tablet_replica.cc:333] stopping tablet replica
W20251215 20:54:03.039830 3851 consensus_peers.cc:597] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.040591 3925 consensus_peers.cc:597] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.040841 426 raft_consensus.cc:2243] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.041268 426 raft_consensus.cc:2272] T cd353b21737a444a83aad51cf35b0050 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.043052 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.043591 426 raft_consensus.cc:2243] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.043963 426 raft_consensus.cc:2272] T c5f721cb539a4588950f815d7376e735 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.046113 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.046672 426 raft_consensus.cc:2243] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.047155 426 raft_consensus.cc:2272] T 15b792f698514fcf976075ab99eda917 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.047323 3925 consensus_peers.cc:597] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.049167 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.049736 426 raft_consensus.cc:2243] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.050104 426 raft_consensus.cc:2272] T c7c37d3270014123b789c11535c96af1 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.052156 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.052704 426 raft_consensus.cc:2243] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.053092 426 raft_consensus.cc:2272] T 87b34b8adfa44d8680e7f070cad3428c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.054919 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.055519 426 raft_consensus.cc:2243] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.056025 426 raft_consensus.cc:2272] T 92aa097b972542fe997003b6178e7e41 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.058455 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.058965 426 raft_consensus.cc:2243] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.059638 426 raft_consensus.cc:2272] T 3f2752ef3d844a1ab4ca11c0d262f78b P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.061388 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.061852 426 raft_consensus.cc:2243] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.062151 426 raft_consensus.cc:2272] T 72a5c0bc6cfd443bb366d645e217dbe7 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.064314 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.064975 426 raft_consensus.cc:2243] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.065438 426 raft_consensus.cc:2272] T d88e0d9134794daab38013d35aadbacd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.065886 3925 consensus_peers.cc:597] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.067291 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.067874 426 raft_consensus.cc:2243] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.068568 426 raft_consensus.cc:2272] T 18007ad8f0ba4c649034cc34d9d4991d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.070333 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.070827 426 raft_consensus.cc:2243] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.071167 426 raft_consensus.cc:2272] T b302275303b54dc3a70558581fd3ae49 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.073225 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.073765 426 raft_consensus.cc:2243] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.074183 426 raft_consensus.cc:2272] T 820e3cc7d81046f1b3436c369048939e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.075542 3925 consensus_peers.cc:597] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.076465 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.077011 426 raft_consensus.cc:2243] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.077358 426 raft_consensus.cc:2272] T 01cbaf89fd054f4cb0385b533fae6f8c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.078933 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.079530 426 raft_consensus.cc:2243] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.079984 426 raft_consensus.cc:2272] T 78e2caf38d18407d85cdbfa8a8230a76 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.081807 3777 consensus_peers.cc:597] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.082305 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.082828 426 raft_consensus.cc:2243] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.083184 426 raft_consensus.cc:2272] T 6f8125d05ac2440d8825d3fffa8fc079 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.085470 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.086148 426 raft_consensus.cc:2243] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 4 LEADER]: Raft consensus shutting down.
W20251215 20:54:03.086560 3777 consensus_peers.cc:597] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.087040 426 raft_consensus.cc:2272] T 0e812e063f2e49a49186f8a05f18c535 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.088842 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.089375 426 raft_consensus.cc:2243] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.090003 426 raft_consensus.cc:2272] T f1ac152899e2447cb009e0cdcfa8c729 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.091670 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.092201 426 raft_consensus.cc:2243] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.092865 426 raft_consensus.cc:2272] T b0459c455a09425d8a6db8c7b275dabd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.094524 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.095005 426 raft_consensus.cc:2243] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.095347 426 raft_consensus.cc:2272] T 723425b3ad41419c9207bc5880db1c1c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.097129 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.097666 426 raft_consensus.cc:2243] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.098337 426 raft_consensus.cc:2272] T 8ff6382eccb248a4a205426da0977b1e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.100618 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.101305 426 raft_consensus.cc:2243] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.101776 426 raft_consensus.cc:2272] T d3b16d8c675f4f6580bf11876ac11bfd P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.102378 3851 consensus_peers.cc:597] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.103088 3777 consensus_peers.cc:597] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.104313 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.104861 426 raft_consensus.cc:2243] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.105243 426 raft_consensus.cc:2272] T 8c98269ae53148f29fa1722a088a3c71 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.106989 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.107503 426 raft_consensus.cc:2243] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.107861 426 raft_consensus.cc:2272] T f4e98056a2e24e4a9381fc3ee9451a8e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.109702 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.110172 426 raft_consensus.cc:2243] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.110823 426 raft_consensus.cc:2272] T 3fa3cc7e66d147f8af03254252cfac85 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.112697 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.113193 426 raft_consensus.cc:2243] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.113600 426 raft_consensus.cc:2272] T 4b7e4d145d7c4085b7ad7d3578605d5c P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.115401 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.115882 426 raft_consensus.cc:2243] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.116540 426 raft_consensus.cc:2272] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.118539 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.119168 426 raft_consensus.cc:2243] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.119561 426 raft_consensus.cc:2272] T 61227fed983e4c8ca9490bf84294f86d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.121508 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.121982 426 raft_consensus.cc:2243] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.122681 426 raft_consensus.cc:2272] T a83049337c094dcb8a7150a796d41592 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.124264 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.124764 426 raft_consensus.cc:2243] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.125087 426 raft_consensus.cc:2272] T 467dc89c982a488b8a405d00a9f39247 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.126758 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.127213 426 raft_consensus.cc:2243] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.127918 426 raft_consensus.cc:2272] T be5be8f0ad8e4eaba735e5da252f993e P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.130070 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.130605 426 raft_consensus.cc:2243] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.130952 426 raft_consensus.cc:2272] T 7a9f02af02424808a0612e7caa798ebb P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.133172 426 tablet_replica.cc:333] stopping tablet replica
W20251215 20:54:03.133345 3925 consensus_peers.cc:597] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.133853 426 raft_consensus.cc:2243] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.134563 426 raft_consensus.cc:2272] T 10876eda60774113b16eca9ad870db31 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.136207 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.136742 426 raft_consensus.cc:2243] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.137197 426 raft_consensus.cc:2272] T 1a03f70d92df4d41bdf5049341172bc4 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.139524 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.139981 426 raft_consensus.cc:2243] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.140460 426 raft_consensus.cc:2272] T 5d37236082954925b36d02b68cbd3a0f P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.142568 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.143174 426 raft_consensus.cc:2243] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.144038 426 raft_consensus.cc:2272] T c0d4826d1ea440588d15aefa34a7be66 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.146037 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.146504 426 raft_consensus.cc:2243] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.147171 426 raft_consensus.cc:2272] T 2d68c2b110ed41cb96b24e3f1034082a P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.149174 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.149760 426 raft_consensus.cc:2243] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.150127 426 raft_consensus.cc:2272] T bccb018083644a71b59e3afc68611be2 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.151037 3851 consensus_peers.cc:597] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.152318 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.152819 426 raft_consensus.cc:2243] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.153537 426 raft_consensus.cc:2272] T f2ff03e068e044b29e3c7843b2dbc453 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.155133 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.155540 426 raft_consensus.cc:2243] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.155840 426 raft_consensus.cc:2272] T 0807745e47db47f7baefd68c4488a72d P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.157521 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.157920 426 raft_consensus.cc:2243] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.158231 426 raft_consensus.cc:2272] T d9f1dde6ceb14bfd881708502fbbc307 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.159796 426 tablet_replica.cc:333] stopping tablet replica
I20251215 20:54:03.160153 426 raft_consensus.cc:2243] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.160506 426 raft_consensus.cc:2272] T 1ac3237768974cdda7de26ef5b8b6740 P 230b971d5efa4b3aa8d8f05fc3a3faec [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.184346 3851 consensus_peers.cc:597] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.213086 426 tablet_server.cc:195] TabletServer@127.0.106.129:40559 shutdown complete.
W20251215 20:54:03.216447 3925 consensus_peers.cc:597] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.218603 3777 consensus_peers.cc:597] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.224452 3851 consensus_peers.cc:597] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.234860 3925 consensus_peers.cc:597] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.235359 3925 consensus_peers.cc:597] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.283998 3925 consensus_peers.cc:597] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.297000 3925 consensus_peers.cc:597] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.343514 3925 consensus_peers.cc:597] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.348366 3851 consensus_peers.cc:597] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.394950 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20251215 20:54:03.405716 3777 consensus_peers.cc:597] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.412690 3851 consensus_peers.cc:597] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.424520 3925 consensus_peers.cc:597] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.428437 3853 consensus_peers.cc:597] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.434993 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:03.436843 426 tablet_replica.cc:333] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.437863 426 raft_consensus.cc:2243] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.439136 426 raft_consensus.cc:2272] T 0807745e47db47f7baefd68c4488a72d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.441918 426 tablet_replica.cc:333] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.442822 426 raft_consensus.cc:2243] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus shutting down.
W20251215 20:54:03.443094 3853 consensus_peers.cc:597] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.443660 426 raft_consensus.cc:2272] T a83049337c094dcb8a7150a796d41592 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.446040 426 tablet_replica.cc:333] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.446658 426 raft_consensus.cc:2243] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.447085 426 raft_consensus.cc:2272] T 8c98269ae53148f29fa1722a088a3c71 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.448982 426 tablet_replica.cc:333] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.449487 426 raft_consensus.cc:2243] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.449939 426 raft_consensus.cc:2272] T b0459c455a09425d8a6db8c7b275dabd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.451750 426 tablet_replica.cc:333] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.452334 426 raft_consensus.cc:2243] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.452719 426 raft_consensus.cc:2272] T 1a03f70d92df4d41bdf5049341172bc4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.454502 426 tablet_replica.cc:333] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.455005 426 raft_consensus.cc:2243] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.455435 426 raft_consensus.cc:2272] T 6a21e159520040a682326bc0b83248ff P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.457894 426 tablet_replica.cc:333] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.458673 426 raft_consensus.cc:2243] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.459473 426 raft_consensus.cc:2272] T b5e9420df6384a1f9822d407d9195e51 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.460178 3853 consensus_peers.cc:597] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.462407 426 tablet_replica.cc:333] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.463241 426 raft_consensus.cc:2243] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.464177 426 raft_consensus.cc:2272] T bccb018083644a71b59e3afc68611be2 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.466511 426 tablet_replica.cc:333] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.467041 426 raft_consensus.cc:2243] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.468781 426 raft_consensus.cc:2272] T 2b7ca5082d6447b0abc43526a605e3fe P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.471635 426 tablet_replica.cc:333] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.472506 426 raft_consensus.cc:2243] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.473259 426 raft_consensus.cc:2272] T f6371592021d429ba136b0ef52728bbb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.476125 426 tablet_replica.cc:333] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.477007 426 raft_consensus.cc:2243] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.478540 426 raft_consensus.cc:2272] T 723425b3ad41419c9207bc5880db1c1c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.480387 426 tablet_replica.cc:333] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.480931 426 raft_consensus.cc:2243] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.482056 426 raft_consensus.cc:2272] T d3b16d8c675f4f6580bf11876ac11bfd P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.483824 426 tablet_replica.cc:333] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.484359 426 raft_consensus.cc:2243] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.484843 426 raft_consensus.cc:2272] T 8ff6382eccb248a4a205426da0977b1e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.486624 426 tablet_replica.cc:333] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.487077 426 raft_consensus.cc:2243] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.487452 426 raft_consensus.cc:2272] T fbcea7686fdf4ece84af2fb29ea12a48 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.489213 426 tablet_replica.cc:333] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.489738 426 raft_consensus.cc:2243] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.490502 426 raft_consensus.cc:2272] T 652957cad9bb4393811a50c064710b1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.492888 426 tablet_replica.cc:333] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.493763 426 raft_consensus.cc:2243] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.494479 426 raft_consensus.cc:2272] T 18007ad8f0ba4c649034cc34d9d4991d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.496974 426 tablet_replica.cc:333] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.497754 426 raft_consensus.cc:2243] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.498811 426 raft_consensus.cc:2272] T 7a9f02af02424808a0612e7caa798ebb P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.501236 426 tablet_replica.cc:333] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.501967 426 raft_consensus.cc:2243] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.502528 426 raft_consensus.cc:2272] T 6888cc3ab31a4688a8fdda25f79dc586 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.504359 426 tablet_replica.cc:333] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.504848 426 raft_consensus.cc:2243] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.505645 426 raft_consensus.cc:2272] T a923d91e17724167884e844da2f5a737 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.508086 426 tablet_replica.cc:333] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.508637 426 raft_consensus.cc:2243] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.509016 426 raft_consensus.cc:2272] T a6ccd6add84b428eb601968b0547c5a6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.511001 426 tablet_replica.cc:333] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.511687 426 raft_consensus.cc:2243] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.512580 426 raft_consensus.cc:2272] T 7eb57a5ba3904de2880d27be51f34c73 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.512930 3851 consensus_peers.cc:597] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.515008 426 tablet_replica.cc:333] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.515816 426 raft_consensus.cc:2243] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.517001 426 raft_consensus.cc:2272] T c4219e2b494847c4b98c41a4181cbcc0 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.519368 426 tablet_replica.cc:333] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.520098 426 raft_consensus.cc:2243] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.520694 426 raft_consensus.cc:2272] T cd353b21737a444a83aad51cf35b0050 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.523118 426 tablet_replica.cc:333] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.523677 426 raft_consensus.cc:2243] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.524083 426 raft_consensus.cc:2272] T 57d49107996447828d7fc624dba56e4d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.526283 426 tablet_replica.cc:333] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.526958 426 raft_consensus.cc:2243] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.527431 426 raft_consensus.cc:2272] T 61227fed983e4c8ca9490bf84294f86d P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.529872 426 tablet_replica.cc:333] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.530575 426 raft_consensus.cc:2243] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.530994 426 raft_consensus.cc:2272] T 50e3aad815f9468187ec1d605addfcb4 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.532966 426 tablet_replica.cc:333] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.533437 426 raft_consensus.cc:2243] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.534116 426 raft_consensus.cc:2272] T 3fa3cc7e66d147f8af03254252cfac85 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.536976 426 tablet_replica.cc:333] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.537707 426 raft_consensus.cc:2243] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
W20251215 20:54:03.538812 3777 consensus_peers.cc:597] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 -> Peer 230b971d5efa4b3aa8d8f05fc3a3faec (127.0.106.129:40559): Couldn't send request to peer 230b971d5efa4b3aa8d8f05fc3a3faec. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.539039 426 raft_consensus.cc:2272] T 4b7e4d145d7c4085b7ad7d3578605d5c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.541817 426 tablet_replica.cc:333] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.542598 426 raft_consensus.cc:2243] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.543272 426 raft_consensus.cc:2272] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.543954 3853 consensus_peers.cc:597] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.545471 426 tablet_replica.cc:333] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.546243 426 raft_consensus.cc:2243] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.547204 426 raft_consensus.cc:2272] T aab07a1cee7745b88f2372e58ead711e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.549615 426 tablet_replica.cc:333] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.550148 426 raft_consensus.cc:2243] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.550527 426 raft_consensus.cc:2272] T 820e3cc7d81046f1b3436c369048939e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.552167 426 tablet_replica.cc:333] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.552663 426 raft_consensus.cc:2243] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.553056 426 raft_consensus.cc:2272] T 01cbaf89fd054f4cb0385b533fae6f8c P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.554754 426 tablet_replica.cc:333] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.555226 426 raft_consensus.cc:2243] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.556263 426 raft_consensus.cc:2272] T 78e2caf38d18407d85cdbfa8a8230a76 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.558317 426 tablet_replica.cc:333] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.558811 426 raft_consensus.cc:2243] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.559223 426 raft_consensus.cc:2272] T 2d68c2b110ed41cb96b24e3f1034082a P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.561012 426 tablet_replica.cc:333] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.561522 426 raft_consensus.cc:2243] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.562005 426 raft_consensus.cc:2272] T c0d4826d1ea440588d15aefa34a7be66 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.564900 426 tablet_replica.cc:333] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.565512 426 raft_consensus.cc:2243] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.566064 426 raft_consensus.cc:2272] T 72a5c0bc6cfd443bb366d645e217dbe7 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.567941 426 tablet_replica.cc:333] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.568590 426 raft_consensus.cc:2243] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.569142 426 raft_consensus.cc:2272] T aef546d01dde465191d2485943bf84b1 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.571521 426 tablet_replica.cc:333] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.572147 426 raft_consensus.cc:2243] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.572752 426 raft_consensus.cc:2272] T 3f2752ef3d844a1ab4ca11c0d262f78b P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.575132 426 tablet_replica.cc:333] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.575763 426 raft_consensus.cc:2243] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.576406 426 raft_consensus.cc:2272] T f1ac152899e2447cb009e0cdcfa8c729 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.578326 426 tablet_replica.cc:333] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.578722 426 raft_consensus.cc:2243] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.579101 426 raft_consensus.cc:2272] T 0e812e063f2e49a49186f8a05f18c535 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.580816 426 tablet_replica.cc:333] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.581239 426 raft_consensus.cc:2243] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.581707 426 raft_consensus.cc:2272] T be5be8f0ad8e4eaba735e5da252f993e P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.583654 426 tablet_replica.cc:333] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.584082 426 raft_consensus.cc:2243] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.584844 426 raft_consensus.cc:2272] T 467dc89c982a488b8a405d00a9f39247 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.586731 426 tablet_replica.cc:333] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.587143 426 raft_consensus.cc:2243] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.587852 426 raft_consensus.cc:2272] T 6fc6542088b34e38ae967eb065f6bd1f P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.589684 426 tablet_replica.cc:333] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53: stopping tablet replica
I20251215 20:54:03.590071 426 raft_consensus.cc:2243] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.590518 426 raft_consensus.cc:2272] T 15b792f698514fcf976075ab99eda917 P 039a78b97c7142de8e3a5cb5d3f5bb53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.645700 3853 consensus_peers.cc:597] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.657953 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
W20251215 20:54:03.706188 3853 consensus_peers.cc:597] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.726429 3927 consensus_peers.cc:597] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.736389 3927 consensus_peers.cc:597] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.747022 3927 consensus_peers.cc:597] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.756364 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
W20251215 20:54:03.760066 3927 consensus_peers.cc:597] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.766497 3927 consensus_peers.cc:597] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.768273 3927 consensus_peers.cc:597] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.768393 3926 consensus_peers.cc:597] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.792959 3926 consensus_peers.cc:597] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.795147 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:03.795933 426 tablet_replica.cc:333] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.796828 426 raft_consensus.cc:2243] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.797354 426 raft_consensus.cc:2272] T 10876eda60774113b16eca9ad870db31 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.799248 426 tablet_replica.cc:333] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.799787 426 raft_consensus.cc:2243] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.800158 426 raft_consensus.cc:2272] T b302275303b54dc3a70558581fd3ae49 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.801946 426 tablet_replica.cc:333] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.802444 426 raft_consensus.cc:2243] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.802801 426 raft_consensus.cc:2272] T 723425b3ad41419c9207bc5880db1c1c P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.804461 426 tablet_replica.cc:333] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.804957 426 raft_consensus.cc:2243] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.805353 426 raft_consensus.cc:2272] T 0807745e47db47f7baefd68c4488a72d P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.807053 426 tablet_replica.cc:333] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.807524 426 raft_consensus.cc:2243] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.807858 426 raft_consensus.cc:2272] T 652957cad9bb4393811a50c064710b1f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.809666 426 tablet_replica.cc:333] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.810158 426 raft_consensus.cc:2243] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.810621 426 raft_consensus.cc:2272] T b0459c455a09425d8a6db8c7b275dabd P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.812543 426 tablet_replica.cc:333] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.813066 426 raft_consensus.cc:2243] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.813807 426 raft_consensus.cc:2272] T b5e9420df6384a1f9822d407d9195e51 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.815776 426 tablet_replica.cc:333] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.816277 426 raft_consensus.cc:2243] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.816799 426 raft_consensus.cc:2272] T bccb018083644a71b59e3afc68611be2 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.819095 426 tablet_replica.cc:333] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.819738 426 raft_consensus.cc:2243] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.820218 426 raft_consensus.cc:2272] T 9214cecd3f6d4af381064ccde6023020 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.822614 426 tablet_replica.cc:333] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.823338 426 raft_consensus.cc:2243] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.824199 426 raft_consensus.cc:2272] T f4e98056a2e24e4a9381fc3ee9451a8e P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.826135 426 tablet_replica.cc:333] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.826817 426 raft_consensus.cc:2243] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.827785 426 raft_consensus.cc:2272] T 8c98269ae53148f29fa1722a088a3c71 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.830387 3853 consensus_peers.cc:597] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.830421 426 tablet_replica.cc:333] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.831310 426 raft_consensus.cc:2243] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.832372 426 raft_consensus.cc:2272] T 6a21e159520040a682326bc0b83248ff P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.832525 3853 consensus_peers.cc:597] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.834496 426 tablet_replica.cc:333] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.835018 426 raft_consensus.cc:2243] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.835675 426 raft_consensus.cc:2272] T 6f8125d05ac2440d8825d3fffa8fc079 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.837397 426 tablet_replica.cc:333] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.837913 426 raft_consensus.cc:2243] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.838289 426 raft_consensus.cc:2272] T 467dc89c982a488b8a405d00a9f39247 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.839923 426 tablet_replica.cc:333] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.840448 426 raft_consensus.cc:2243] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.841123 426 raft_consensus.cc:2272] T f6371592021d429ba136b0ef52728bbb P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.842742 426 tablet_replica.cc:333] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.843199 426 raft_consensus.cc:2243] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.843585 426 raft_consensus.cc:2272] T 6fc6542088b34e38ae967eb065f6bd1f P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.845218 426 tablet_replica.cc:333] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.845698 426 raft_consensus.cc:2243] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.846397 426 raft_consensus.cc:2272] T c5f721cb539a4588950f815d7376e735 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.847965 426 tablet_replica.cc:333] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.848481 426 raft_consensus.cc:2243] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.849133 426 raft_consensus.cc:2272] T 15b792f698514fcf976075ab99eda917 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.851168 426 tablet_replica.cc:333] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.851770 426 raft_consensus.cc:2243] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.852211 426 raft_consensus.cc:2272] T 1ac3237768974cdda7de26ef5b8b6740 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.853217 3927 consensus_peers.cc:597] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 -> Peer 039a78b97c7142de8e3a5cb5d3f5bb53 (127.0.106.130:43049): Couldn't send request to peer 039a78b97c7142de8e3a5cb5d3f5bb53. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.854375 426 tablet_replica.cc:333] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.854907 426 raft_consensus.cc:2243] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.855257 426 raft_consensus.cc:2272] T d9f1dde6ceb14bfd881708502fbbc307 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.857005 426 tablet_replica.cc:333] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.857637 426 raft_consensus.cc:2243] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.858122 426 raft_consensus.cc:2272] T fbcea7686fdf4ece84af2fb29ea12a48 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.860356 426 tablet_replica.cc:333] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.860904 426 raft_consensus.cc:2243] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.861462 426 raft_consensus.cc:2272] T 87b34b8adfa44d8680e7f070cad3428c P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.863883 426 tablet_replica.cc:333] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.864639 426 raft_consensus.cc:2243] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.865115 426 raft_consensus.cc:2272] T 7a9f02af02424808a0612e7caa798ebb P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.867203 426 tablet_replica.cc:333] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.867714 426 raft_consensus.cc:2243] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.868424 426 raft_consensus.cc:2272] T 6888cc3ab31a4688a8fdda25f79dc586 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.870029 426 tablet_replica.cc:333] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.870463 426 raft_consensus.cc:2243] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.870826 426 raft_consensus.cc:2272] T 7eb57a5ba3904de2880d27be51f34c73 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.872527 426 tablet_replica.cc:333] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.873008 426 raft_consensus.cc:2243] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.873435 426 raft_consensus.cc:2272] T f2ff03e068e044b29e3c7843b2dbc453 P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.875017 426 tablet_replica.cc:333] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.875447 426 raft_consensus.cc:2243] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.875792 426 raft_consensus.cc:2272] T c4219e2b494847c4b98c41a4181cbcc0 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.877341 426 tablet_replica.cc:333] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.877781 426 raft_consensus.cc:2243] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.878137 426 raft_consensus.cc:2272] T a923d91e17724167884e844da2f5a737 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.879782 426 tablet_replica.cc:333] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.880218 426 raft_consensus.cc:2243] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.880897 426 raft_consensus.cc:2272] T a6ccd6add84b428eb601968b0547c5a6 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.882591 426 tablet_replica.cc:333] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.883042 426 raft_consensus.cc:2243] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.883656 426 raft_consensus.cc:2272] T 4a40f55e64934e3384ce7a7e98833ebc P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.885401 426 tablet_replica.cc:333] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.885864 426 raft_consensus.cc:2243] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.886222 426 raft_consensus.cc:2272] T d88e0d9134794daab38013d35aadbacd P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.888094 426 tablet_replica.cc:333] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.888738 426 raft_consensus.cc:2243] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.889178 426 raft_consensus.cc:2272] T 57d49107996447828d7fc624dba56e4d P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.889931 3926 consensus_peers.cc:597] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.891132 426 tablet_replica.cc:333] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.891678 426 raft_consensus.cc:2243] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.892041 426 raft_consensus.cc:2272] T 2b7ca5082d6447b0abc43526a605e3fe P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.893738 426 tablet_replica.cc:333] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.894208 426 raft_consensus.cc:2243] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.894547 426 raft_consensus.cc:2272] T c7c37d3270014123b789c11535c96af1 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.896665 426 tablet_replica.cc:333] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.897212 426 raft_consensus.cc:2243] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Raft consensus shutting down.
W20251215 20:54:03.897224 3926 consensus_peers.cc:597] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.898099 426 raft_consensus.cc:2272] T 50e3aad815f9468187ec1d605addfcb4 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.899682 426 tablet_replica.cc:333] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.900120 426 raft_consensus.cc:2243] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.900501 426 raft_consensus.cc:2272] T e6511a4d6d3149b2a8cf9bd821bfbfa6 P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.902105 426 tablet_replica.cc:333] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.902534 426 raft_consensus.cc:2243] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.902860 426 raft_consensus.cc:2272] T aab07a1cee7745b88f2372e58ead711e P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.904505 426 tablet_replica.cc:333] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.904955 426 raft_consensus.cc:2243] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.905340 426 raft_consensus.cc:2272] T 78e2caf38d18407d85cdbfa8a8230a76 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.906970 426 tablet_replica.cc:333] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.907377 426 raft_consensus.cc:2243] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.908058 426 raft_consensus.cc:2272] T 820e3cc7d81046f1b3436c369048939e P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.909649 426 tablet_replica.cc:333] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.910063 426 raft_consensus.cc:2243] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.910374 426 raft_consensus.cc:2272] T 92aa097b972542fe997003b6178e7e41 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.911880 426 tablet_replica.cc:333] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.912436 426 raft_consensus.cc:2243] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.913285 426 raft_consensus.cc:2272] T aef546d01dde465191d2485943bf84b1 P 36692678524d48f8b2e8cc240e9ce254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.915002 426 tablet_replica.cc:333] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.915496 426 raft_consensus.cc:2243] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.915896 426 raft_consensus.cc:2272] T 3f2752ef3d844a1ab4ca11c0d262f78b P 36692678524d48f8b2e8cc240e9ce254 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.917515 426 tablet_replica.cc:333] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.917922 426 raft_consensus.cc:2243] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:03.918543 426 raft_consensus.cc:2272] T 5d37236082954925b36d02b68cbd3a0f P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:03.920275 426 tablet_replica.cc:333] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254: stopping tablet replica
I20251215 20:54:03.920743 426 raft_consensus.cc:2243] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:03.921119 426 raft_consensus.cc:2272] T c0d4826d1ea440588d15aefa34a7be66 P 36692678524d48f8b2e8cc240e9ce254 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:03.925412 3926 consensus_peers.cc:597] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.965528 3926 consensus_peers.cc:597] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:03.969898 3926 consensus_peers.cc:597] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:03.988173 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
W20251215 20:54:04.019891 3926 consensus_peers.cc:597] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:45041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:04.029628 3926 consensus_peers.cc:597] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 -> Peer 36692678524d48f8b2e8cc240e9ce254 (127.0.106.131:45041): Couldn't send request to peer 36692678524d48f8b2e8cc240e9ce254. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:45041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:04.048588 426 tablet_server.cc:178] TabletServer@127.0.106.132:0 shutting down...
I20251215 20:54:04.079844 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:04.080756 426 tablet_replica.cc:333] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.081547 426 raft_consensus.cc:2243] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.082149 426 raft_consensus.cc:2272] T 10876eda60774113b16eca9ad870db31 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.084671 426 tablet_replica.cc:333] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.085400 426 raft_consensus.cc:2243] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.085827 426 raft_consensus.cc:2272] T b5e9420df6384a1f9822d407d9195e51 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.087893 426 tablet_replica.cc:333] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.088421 426 raft_consensus.cc:2243] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.089107 426 raft_consensus.cc:2272] T b302275303b54dc3a70558581fd3ae49 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.090752 426 tablet_replica.cc:333] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.091275 426 raft_consensus.cc:2243] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.091646 426 raft_consensus.cc:2272] T 5d37236082954925b36d02b68cbd3a0f P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.093252 426 tablet_replica.cc:333] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.093739 426 raft_consensus.cc:2243] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.094101 426 raft_consensus.cc:2272] T f4e98056a2e24e4a9381fc3ee9451a8e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.095675 426 tablet_replica.cc:333] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.096149 426 raft_consensus.cc:2243] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.096844 426 raft_consensus.cc:2272] T 1a03f70d92df4d41bdf5049341172bc4 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.098510 426 tablet_replica.cc:333] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.099032 426 raft_consensus.cc:2243] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.099380 426 raft_consensus.cc:2272] T 6a21e159520040a682326bc0b83248ff P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.101083 426 tablet_replica.cc:333] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.101574 426 raft_consensus.cc:2243] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.102245 426 raft_consensus.cc:2272] T 9214cecd3f6d4af381064ccde6023020 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.103837 426 tablet_replica.cc:333] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.104341 426 raft_consensus.cc:2243] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.105027 426 raft_consensus.cc:2272] T 72a5c0bc6cfd443bb366d645e217dbe7 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.106973 426 tablet_replica.cc:333] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.107432 426 raft_consensus.cc:2243] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.107805 426 raft_consensus.cc:2272] T aef546d01dde465191d2485943bf84b1 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.109373 426 tablet_replica.cc:333] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.109828 426 raft_consensus.cc:2243] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.110474 426 raft_consensus.cc:2272] T 92aa097b972542fe997003b6178e7e41 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.112039 426 tablet_replica.cc:333] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.112502 426 raft_consensus.cc:2243] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.112879 426 raft_consensus.cc:2272] T be5be8f0ad8e4eaba735e5da252f993e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.114450 426 tablet_replica.cc:333] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.114902 426 raft_consensus.cc:2243] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.115254 426 raft_consensus.cc:2272] T f6371592021d429ba136b0ef52728bbb P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.116807 426 tablet_replica.cc:333] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.117267 426 raft_consensus.cc:2243] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.117671 426 raft_consensus.cc:2272] T a83049337c094dcb8a7150a796d41592 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.119261 426 tablet_replica.cc:333] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.119735 426 raft_consensus.cc:2243] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.120095 426 raft_consensus.cc:2272] T 2d68c2b110ed41cb96b24e3f1034082a P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.121677 426 tablet_replica.cc:333] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.122169 426 raft_consensus.cc:2243] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.122532 426 raft_consensus.cc:2272] T d3b16d8c675f4f6580bf11876ac11bfd P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.124051 426 tablet_replica.cc:333] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.124544 426 raft_consensus.cc:2243] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.124943 426 raft_consensus.cc:2272] T 8ff6382eccb248a4a205426da0977b1e P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.126502 426 tablet_replica.cc:333] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.126961 426 raft_consensus.cc:2243] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.127308 426 raft_consensus.cc:2272] T aab07a1cee7745b88f2372e58ead711e P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.128897 426 tablet_replica.cc:333] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.129354 426 raft_consensus.cc:2243] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.130038 426 raft_consensus.cc:2272] T d9f1dde6ceb14bfd881708502fbbc307 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.131628 426 tablet_replica.cc:333] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.132079 426 raft_consensus.cc:2243] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.132764 426 raft_consensus.cc:2272] T fbcea7686fdf4ece84af2fb29ea12a48 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.134754 426 tablet_replica.cc:333] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.135406 426 raft_consensus.cc:2243] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.136215 426 raft_consensus.cc:2272] T 87b34b8adfa44d8680e7f070cad3428c P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.138404 426 tablet_replica.cc:333] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.138835 426 raft_consensus.cc:2243] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.139173 426 raft_consensus.cc:2272] T 4a40f55e64934e3384ce7a7e98833ebc P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.140826 426 tablet_replica.cc:333] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.141291 426 raft_consensus.cc:2243] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.141637 426 raft_consensus.cc:2272] T 652957cad9bb4393811a50c064710b1f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.143160 426 tablet_replica.cc:333] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.143595 426 raft_consensus.cc:2243] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.143941 426 raft_consensus.cc:2272] T 18007ad8f0ba4c649034cc34d9d4991d P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.145529 426 tablet_replica.cc:333] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.145970 426 raft_consensus.cc:2243] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.146327 426 raft_consensus.cc:2272] T f2ff03e068e044b29e3c7843b2dbc453 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.147933 426 tablet_replica.cc:333] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.148414 426 raft_consensus.cc:2243] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.148782 426 raft_consensus.cc:2272] T 7eb57a5ba3904de2880d27be51f34c73 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.150354 426 tablet_replica.cc:333] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.150812 426 raft_consensus.cc:2243] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.151176 426 raft_consensus.cc:2272] T c4219e2b494847c4b98c41a4181cbcc0 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.153510 426 tablet_replica.cc:333] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.154155 426 raft_consensus.cc:2243] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.154767 426 raft_consensus.cc:2272] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185 [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:04.154894 4835 raft_consensus.cc:670] T f1ac152899e2447cb009e0cdcfa8c729 P b6f1369e205047049f1aa9f78c06c185: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20251215 20:54:04.156994 426 tablet_replica.cc:333] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.157418 426 raft_consensus.cc:2243] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.157756 426 raft_consensus.cc:2272] T 0e812e063f2e49a49186f8a05f18c535 P b6f1369e205047049f1aa9f78c06c185 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.159315 426 tablet_replica.cc:333] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.159734 426 raft_consensus.cc:2243] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.160051 426 raft_consensus.cc:2272] T 6f8125d05ac2440d8825d3fffa8fc079 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.161695 426 tablet_replica.cc:333] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.162103 426 raft_consensus.cc:2243] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.162734 426 raft_consensus.cc:2272] T 61227fed983e4c8ca9490bf84294f86d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.164311 426 tablet_replica.cc:333] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.164775 426 raft_consensus.cc:2243] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.165156 426 raft_consensus.cc:2272] T 50e3aad815f9468187ec1d605addfcb4 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.166631 426 tablet_replica.cc:333] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.167035 426 raft_consensus.cc:2243] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.167354 426 raft_consensus.cc:2272] T 4b7e4d145d7c4085b7ad7d3578605d5c P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.168884 426 tablet_replica.cc:333] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.169281 426 raft_consensus.cc:2243] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.169611 426 raft_consensus.cc:2272] T 3fa3cc7e66d147f8af03254252cfac85 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.171097 426 tablet_replica.cc:333] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.171522 426 raft_consensus.cc:2243] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.171856 426 raft_consensus.cc:2272] T c5f721cb539a4588950f815d7376e735 P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.173400 426 tablet_replica.cc:333] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.173810 426 raft_consensus.cc:2243] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.174470 426 raft_consensus.cc:2272] T 01cbaf89fd054f4cb0385b533fae6f8c P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.176020 426 tablet_replica.cc:333] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.176483 426 raft_consensus.cc:2243] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.177093 426 raft_consensus.cc:2272] T d88e0d9134794daab38013d35aadbacd P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.178622 426 tablet_replica.cc:333] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.179044 426 raft_consensus.cc:2243] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.179641 426 raft_consensus.cc:2272] T cd353b21737a444a83aad51cf35b0050 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.181190 426 tablet_replica.cc:333] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.181607 426 raft_consensus.cc:2243] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.182261 426 raft_consensus.cc:2272] T 57d49107996447828d7fc624dba56e4d P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.183835 426 tablet_replica.cc:333] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.184242 426 raft_consensus.cc:2243] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.184628 426 raft_consensus.cc:2272] T 2b7ca5082d6447b0abc43526a605e3fe P b6f1369e205047049f1aa9f78c06c185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.186151 426 tablet_replica.cc:333] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.186568 426 raft_consensus.cc:2243] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.187206 426 raft_consensus.cc:2272] T c7c37d3270014123b789c11535c96af1 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.188796 426 tablet_replica.cc:333] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.189188 426 raft_consensus.cc:2243] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.189508 426 raft_consensus.cc:2272] T 6fc6542088b34e38ae967eb065f6bd1f P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.191037 426 tablet_replica.cc:333] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.191419 426 raft_consensus.cc:2243] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.192005 426 raft_consensus.cc:2272] T 1ac3237768974cdda7de26ef5b8b6740 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.193590 426 tablet_replica.cc:333] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185: stopping tablet replica
I20251215 20:54:04.193964 426 raft_consensus.cc:2243] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:04.194290 426 raft_consensus.cc:2272] T 6888cc3ab31a4688a8fdda25f79dc586 P b6f1369e205047049f1aa9f78c06c185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.251116 426 tablet_server.cc:195] TabletServer@127.0.106.132:0 shutdown complete.
I20251215 20:54:04.303622 426 master.cc:561] Master@127.0.106.190:35753 shutting down...
I20251215 20:54:04.324455 426 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:04.324962 426 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:04.325232 426 tablet_replica.cc:333] T 00000000000000000000000000000000 P 713c63a7487d439ba1075c4e5fd745df: stopping tablet replica
I20251215 20:54:04.345139 426 master.cc:583] Master@127.0.106.190:35753 shutdown complete.
[ OK ] LeaderRebalancerTest.RestartTserver (28763 ms)
[ RUN ] LeaderRebalancerTest.TestMaintenanceMode
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:475: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (6 ms)
[----------] 5 tests from LeaderRebalancerTest (174556 ms total)
[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20251215 20:54:04.426862 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:44937
I20251215 20:54:04.427902 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:54:04.432858 4838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:04.434082 4839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:04.434356 4841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:04.434715 426 server_base.cc:1047] running on GCE node
I20251215 20:54:04.435542 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:54:04.435735 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:54:04.435868 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832044435850 us; error 0 us; skew 500 ppm
I20251215 20:54:04.436352 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:54:04.438445 426 webserver.cc:492] Webserver started at http://127.0.106.190:44353/ using document root <none> and password file <none>
I20251215 20:54:04.438899 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:54:04.439069 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:54:04.439294 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:54:04.440407 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/master-0-root/instance:
uuid: "2d19afe3804a4768a5553fce0a578d2a"
format_stamp: "Formatted at 2025-12-15 20:54:04 on dist-test-slave-xp5d"
I20251215 20:54:04.444360 426 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251215 20:54:04.447364 4846 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.447985 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20251215 20:54:04.448225 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/master-0-root
uuid: "2d19afe3804a4768a5553fce0a578d2a"
format_stamp: "Formatted at 2025-12-15 20:54:04 on dist-test-slave-xp5d"
I20251215 20:54:04.448508 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:54:04.466661 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:54:04.467763 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:54:04.502274 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:44937
I20251215 20:54:04.502365 4897 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:44937 every 8 connection(s)
I20251215 20:54:04.505973 4898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:04.515700 4898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a: Bootstrap starting.
I20251215 20:54:04.520023 4898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:04.523813 4898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a: No bootstrap required, opened a new log
I20251215 20:54:04.525767 4898 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d19afe3804a4768a5553fce0a578d2a" member_type: VOTER }
I20251215 20:54:04.526144 4898 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:04.526366 4898 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d19afe3804a4768a5553fce0a578d2a, State: Initialized, Role: FOLLOWER
I20251215 20:54:04.526906 4898 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d19afe3804a4768a5553fce0a578d2a" member_type: VOTER }
I20251215 20:54:04.527350 4898 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251215 20:54:04.527554 4898 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251215 20:54:04.527802 4898 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:04.531612 4898 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d19afe3804a4768a5553fce0a578d2a" member_type: VOTER }
I20251215 20:54:04.532066 4898 leader_election.cc:304] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d19afe3804a4768a5553fce0a578d2a; no voters:
I20251215 20:54:04.533066 4898 leader_election.cc:290] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20251215 20:54:04.533385 4901 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:04.534636 4901 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 1 LEADER]: Becoming Leader. State: Replica: 2d19afe3804a4768a5553fce0a578d2a, State: Running, Role: LEADER
I20251215 20:54:04.535251 4901 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d19afe3804a4768a5553fce0a578d2a" member_type: VOTER }
I20251215 20:54:04.535760 4898 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [sys.catalog]: configured and running, proceeding with master startup.
I20251215 20:54:04.541036 4902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d19afe3804a4768a5553fce0a578d2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d19afe3804a4768a5553fce0a578d2a" member_type: VOTER } }
I20251215 20:54:04.541128 4903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d19afe3804a4768a5553fce0a578d2a. Latest consensus state: current_term: 1 leader_uuid: "2d19afe3804a4768a5553fce0a578d2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d19afe3804a4768a5553fce0a578d2a" member_type: VOTER } }
I20251215 20:54:04.541786 4902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [sys.catalog]: This master's current role is: LEADER
I20251215 20:54:04.541826 4903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [sys.catalog]: This master's current role is: LEADER
I20251215 20:54:04.543637 4911 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251215 20:54:04.548482 4911 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251215 20:54:04.549391 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251215 20:54:04.556082 4911 catalog_manager.cc:1357] Generated new cluster ID: d10a65abc51942609f33415a4bf9861f
I20251215 20:54:04.556342 4911 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251215 20:54:04.582338 4911 catalog_manager.cc:1380] Generated new certificate authority record
I20251215 20:54:04.583417 4911 catalog_manager.cc:1514] Loading token signing keys...
I20251215 20:54:04.600821 4911 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a: Generated new TSK 0
I20251215 20:54:04.601301 4911 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251215 20:54:04.615167 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:54:04.620740 4919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:04.621620 4920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:04.623025 4922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:04.623237 426 server_base.cc:1047] running on GCE node
I20251215 20:54:04.624188 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:54:04.624408 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:54:04.624562 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832044624545 us; error 0 us; skew 500 ppm
I20251215 20:54:04.625056 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:54:04.627048 426 webserver.cc:492] Webserver started at http://127.0.106.129:41671/ using document root <none> and password file <none>
I20251215 20:54:04.627494 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:54:04.627657 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:54:04.627887 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:54:04.628895 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-0-root/instance:
uuid: "c1d56ae93a9e42e0b257f491deb526ae"
format_stamp: "Formatted at 2025-12-15 20:54:04 on dist-test-slave-xp5d"
I20251215 20:54:04.632941 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20251215 20:54:04.635826 4927 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.636519 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251215 20:54:04.636772 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-0-root
uuid: "c1d56ae93a9e42e0b257f491deb526ae"
format_stamp: "Formatted at 2025-12-15 20:54:04 on dist-test-slave-xp5d"
I20251215 20:54:04.637039 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:54:04.648880 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:54:04.649891 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:54:04.651242 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:54:04.653297 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:54:04.653482 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.653694 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:54:04.653836 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.691072 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:41493
I20251215 20:54:04.691166 4989 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:41493 every 8 connection(s)
I20251215 20:54:04.695250 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:54:04.701767 4994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:04.702594 4995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:04.705405 426 server_base.cc:1047] running on GCE node
W20251215 20:54:04.705602 4997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:04.706523 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:54:04.706732 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:54:04.706878 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832044706862 us; error 0 us; skew 500 ppm
I20251215 20:54:04.707334 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:54:04.709316 426 webserver.cc:492] Webserver started at http://127.0.106.130:33081/ using document root <none> and password file <none>
I20251215 20:54:04.709764 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:54:04.709936 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:54:04.710162 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:54:04.711467 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-1-root/instance:
uuid: "7adbc795f55441b6bccad811ca6f95c6"
format_stamp: "Formatted at 2025-12-15 20:54:04 on dist-test-slave-xp5d"
I20251215 20:54:04.713598 4990 heartbeater.cc:344] Connected to a master server at 127.0.106.190:44937
I20251215 20:54:04.714026 4990 heartbeater.cc:461] Registering TS with master...
I20251215 20:54:04.714854 4990 heartbeater.cc:507] Master 127.0.106.190:44937 requested a full tablet report, sending...
I20251215 20:54:04.717382 4863 ts_manager.cc:194] Registered new tserver with Master: c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493)
I20251215 20:54:04.719622 4863 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45478
I20251215 20:54:04.719825 426 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.004s
I20251215 20:54:04.724174 5002 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.724865 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251215 20:54:04.725098 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-1-root
uuid: "7adbc795f55441b6bccad811ca6f95c6"
format_stamp: "Formatted at 2025-12-15 20:54:04 on dist-test-slave-xp5d"
I20251215 20:54:04.725333 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:54:04.736688 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:54:04.737743 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:54:04.739040 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:54:04.741058 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:54:04.741240 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.741443 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:54:04.741586 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.777793 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:43823
I20251215 20:54:04.777880 5064 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:43823 every 8 connection(s)
I20251215 20:54:04.782089 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:54:04.788439 5068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:04.789404 5069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:04.792141 5071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:04.793031 5065 heartbeater.cc:344] Connected to a master server at 127.0.106.190:44937
I20251215 20:54:04.793192 426 server_base.cc:1047] running on GCE node
I20251215 20:54:04.793476 5065 heartbeater.cc:461] Registering TS with master...
I20251215 20:54:04.794070 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251215 20:54:04.794181 5065 heartbeater.cc:507] Master 127.0.106.190:44937 requested a full tablet report, sending...
W20251215 20:54:04.794308 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:54:04.794605 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832044794583 us; error 0 us; skew 500 ppm
I20251215 20:54:04.795238 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:54:04.796130 4863 ts_manager.cc:194] Registered new tserver with Master: 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:04.797608 426 webserver.cc:492] Webserver started at http://127.0.106.131:44387/ using document root <none> and password file <none>
I20251215 20:54:04.797619 4863 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45484
I20251215 20:54:04.798180 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:54:04.798391 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:54:04.798695 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:54:04.799758 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-2-root/instance:
uuid: "112ac20bd86a4be9a90456833a5c664d"
format_stamp: "Formatted at 2025-12-15 20:54:04 on dist-test-slave-xp5d"
I20251215 20:54:04.803681 426 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251215 20:54:04.806573 5076 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.807229 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251215 20:54:04.807487 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-2-root
uuid: "112ac20bd86a4be9a90456833a5c664d"
format_stamp: "Formatted at 2025-12-15 20:54:04 on dist-test-slave-xp5d"
I20251215 20:54:04.807727 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1765831869714107-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:54:04.817762 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:54:04.818758 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:54:04.820019 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:54:04.822023 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:54:04.822242 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.822489 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:54:04.822638 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:04.859207 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:32819
I20251215 20:54:04.859295 5138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:32819 every 8 connection(s)
I20251215 20:54:04.871145 5139 heartbeater.cc:344] Connected to a master server at 127.0.106.190:44937
I20251215 20:54:04.871500 5139 heartbeater.cc:461] Registering TS with master...
I20251215 20:54:04.872097 5139 heartbeater.cc:507] Master 127.0.106.190:44937 requested a full tablet report, sending...
I20251215 20:54:04.873754 4863 ts_manager.cc:194] Registered new tserver with Master: 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:04.873911 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.011943353s
I20251215 20:54:04.874958 4863 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45496
I20251215 20:54:04.876207 426 test_util.cc:276] Using random seed: -809201258
I20251215 20:54:04.895269 4863 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45506:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 20:54:04.897784 4863 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 20:54:04.973707 5104 tablet_service.cc:1505] Processing CreateTablet for tablet 0e4d9d75a8b8414091c31038c21d0405 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:04.974052 5103 tablet_service.cc:1505] Processing CreateTablet for tablet 3baa177654f34e04a16b0024a32bcbb2 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:04.975142 5104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4d9d75a8b8414091c31038c21d0405. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:04.975952 5103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3baa177654f34e04a16b0024a32bcbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:04.976847 5100 tablet_service.cc:1505] Processing CreateTablet for tablet 1f9bc5301f3f4050a2453e0f7f8d6346 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:04.978155 5100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9bc5301f3f4050a2453e0f7f8d6346. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:04.981374 5097 tablet_service.cc:1505] Processing CreateTablet for tablet d9e71d96233a4ebd99e5927a05efdd45 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:04.982616 5097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e71d96233a4ebd99e5927a05efdd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:04.982470 5098 tablet_service.cc:1505] Processing CreateTablet for tablet 77bd7419b1c44dd3a3e51a9737153b52 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:04.984731 5101 tablet_service.cc:1505] Processing CreateTablet for tablet e6ca2cafde6344908c62983bdc54b642 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:04.981408 5099 tablet_service.cc:1505] Processing CreateTablet for tablet 8f89ce175118468590c163a82684f58d (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:04.975395 5102 tablet_service.cc:1505] Processing CreateTablet for tablet 95ebe2c267704faeb129378e03859d4f (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:04.988103 5098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bd7419b1c44dd3a3e51a9737153b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:04.992690 5102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ebe2c267704faeb129378e03859d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:04.996376 5099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f89ce175118468590c163a82684f58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:04.998677 5101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ca2cafde6344908c62983bdc54b642. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.006049 5103 tablet_service.cc:1505] Processing CreateTablet for tablet 4609948393fc4c0a98313eddb4c52917 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:05.009555 5103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4609948393fc4c0a98313eddb4c52917. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.023699 5030 tablet_service.cc:1505] Processing CreateTablet for tablet 0e4d9d75a8b8414091c31038c21d0405 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:05.025034 5030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4d9d75a8b8414091c31038c21d0405. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.031289 5154 tablet_bootstrap.cc:492] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.032728 5028 tablet_service.cc:1505] Processing CreateTablet for tablet 95ebe2c267704faeb129378e03859d4f (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:05.034008 5028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ebe2c267704faeb129378e03859d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.033727 5025 tablet_service.cc:1505] Processing CreateTablet for tablet 8f89ce175118468590c163a82684f58d (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:05.034925 5025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f89ce175118468590c163a82684f58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.035887 4955 tablet_service.cc:1505] Processing CreateTablet for tablet 0e4d9d75a8b8414091c31038c21d0405 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:05.037448 5154 tablet_bootstrap.cc:654] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.031507 5029 tablet_service.cc:1505] Processing CreateTablet for tablet 3baa177654f34e04a16b0024a32bcbb2 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:05.038484 5022 tablet_service.cc:1505] Processing CreateTablet for tablet 4609948393fc4c0a98313eddb4c52917 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:05.035950 5027 tablet_service.cc:1505] Processing CreateTablet for tablet e6ca2cafde6344908c62983bdc54b642 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:05.039016 4954 tablet_service.cc:1505] Processing CreateTablet for tablet 3baa177654f34e04a16b0024a32bcbb2 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:05.040184 5024 tablet_service.cc:1505] Processing CreateTablet for tablet 77bd7419b1c44dd3a3e51a9737153b52 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:05.037266 5026 tablet_service.cc:1505] Processing CreateTablet for tablet 1f9bc5301f3f4050a2453e0f7f8d6346 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:05.038529 5029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3baa177654f34e04a16b0024a32bcbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.042598 4953 tablet_service.cc:1505] Processing CreateTablet for tablet 95ebe2c267704faeb129378e03859d4f (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:05.043833 5027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ca2cafde6344908c62983bdc54b642. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.037274 5023 tablet_service.cc:1505] Processing CreateTablet for tablet d9e71d96233a4ebd99e5927a05efdd45 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:05.044476 5026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9bc5301f3f4050a2453e0f7f8d6346. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.045480 5022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4609948393fc4c0a98313eddb4c52917. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.037245 4955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4d9d75a8b8414091c31038c21d0405. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.046496 4953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ebe2c267704faeb129378e03859d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.047587 4954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3baa177654f34e04a16b0024a32bcbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.052572 5023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e71d96233a4ebd99e5927a05efdd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.056061 4952 tablet_service.cc:1505] Processing CreateTablet for tablet e6ca2cafde6344908c62983bdc54b642 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:05.057514 4952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ca2cafde6344908c62983bdc54b642. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.056608 5024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bd7419b1c44dd3a3e51a9737153b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.060892 4951 tablet_service.cc:1505] Processing CreateTablet for tablet 1f9bc5301f3f4050a2453e0f7f8d6346 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:05.062309 4951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9bc5301f3f4050a2453e0f7f8d6346. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.065521 4950 tablet_service.cc:1505] Processing CreateTablet for tablet 8f89ce175118468590c163a82684f58d (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:05.066934 4950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f89ce175118468590c163a82684f58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.069491 4949 tablet_service.cc:1505] Processing CreateTablet for tablet 77bd7419b1c44dd3a3e51a9737153b52 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:05.070842 4949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bd7419b1c44dd3a3e51a9737153b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.073534 4948 tablet_service.cc:1505] Processing CreateTablet for tablet d9e71d96233a4ebd99e5927a05efdd45 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:05.074858 4948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e71d96233a4ebd99e5927a05efdd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.077718 4947 tablet_service.cc:1505] Processing CreateTablet for tablet 4609948393fc4c0a98313eddb4c52917 (DEFAULT_TABLE table=test-workload [id=ba5a68b1a1e04f019b88c8b17c86a939]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:05.079051 4947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4609948393fc4c0a98313eddb4c52917. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:05.206316 5157 tablet_bootstrap.cc:492] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.209025 5154 tablet_bootstrap.cc:492] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.209625 5154 ts_tablet_manager.cc:1403] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.179s user 0.082s sys 0.094s
I20251215 20:54:05.211265 5156 tablet_bootstrap.cc:492] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.212375 5157 tablet_bootstrap.cc:654] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.212431 5154 raft_consensus.cc:359] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.213301 5154 raft_consensus.cc:385] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.213591 5154 raft_consensus.cc:740] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.214260 5154 consensus_queue.cc:260] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.216379 5139 heartbeater.cc:499] Master 127.0.106.190:44937 was elected leader, sending a full tablet report...
I20251215 20:54:05.216866 5157 tablet_bootstrap.cc:492] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.216989 5154 ts_tablet_manager.cc:1434] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20251215 20:54:05.217443 5157 ts_tablet_manager.cc:1403] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.009s
I20251215 20:54:05.218040 5154 tablet_bootstrap.cc:492] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.218329 5156 tablet_bootstrap.cc:654] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.220258 5157 raft_consensus.cc:359] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.221076 5157 raft_consensus.cc:385] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.221408 5157 raft_consensus.cc:740] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.222163 5157 consensus_queue.cc:260] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.223889 5154 tablet_bootstrap.cc:654] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.230975 4990 heartbeater.cc:499] Master 127.0.106.190:44937 was elected leader, sending a full tablet report...
I20251215 20:54:05.231730 5157 ts_tablet_manager.cc:1434] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.014s user 0.005s sys 0.007s
I20251215 20:54:05.232589 5154 tablet_bootstrap.cc:492] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.232965 5157 tablet_bootstrap.cc:492] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.233052 5154 ts_tablet_manager.cc:1403] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.005s
I20251215 20:54:05.235903 5154 raft_consensus.cc:359] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.236578 5154 raft_consensus.cc:385] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.236967 5154 raft_consensus.cc:740] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.237841 5154 consensus_queue.cc:260] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.239373 5157 tablet_bootstrap.cc:654] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.240618 5154 ts_tablet_manager.cc:1434] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251215 20:54:05.241565 5154 tablet_bootstrap.cc:492] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.247226 5154 tablet_bootstrap.cc:654] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.250907 5157 tablet_bootstrap.cc:492] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.251345 5157 ts_tablet_manager.cc:1403] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.010s
I20251215 20:54:05.252364 5156 tablet_bootstrap.cc:492] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.252876 5156 ts_tablet_manager.cc:1403] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.042s user 0.017s sys 0.021s
I20251215 20:54:05.253773 5157 raft_consensus.cc:359] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.254446 5157 raft_consensus.cc:385] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.254722 5157 raft_consensus.cc:740] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.255321 5157 consensus_queue.cc:260] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.255604 5156 raft_consensus.cc:359] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.256376 5156 raft_consensus.cc:385] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.256685 5156 raft_consensus.cc:740] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.257493 5157 ts_tablet_manager.cc:1434] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251215 20:54:05.257426 5156 consensus_queue.cc:260] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.258423 5157 tablet_bootstrap.cc:492] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.261343 5065 heartbeater.cc:499] Master 127.0.106.190:44937 was elected leader, sending a full tablet report...
I20251215 20:54:05.261981 5156 ts_tablet_manager.cc:1434] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20251215 20:54:05.262884 5156 tablet_bootstrap.cc:492] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.264674 5157 tablet_bootstrap.cc:654] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.266896 5154 tablet_bootstrap.cc:492] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.267338 5154 ts_tablet_manager.cc:1403] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.012s
I20251215 20:54:05.268694 5156 tablet_bootstrap.cc:654] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.269889 5154 raft_consensus.cc:359] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.270586 5154 raft_consensus.cc:385] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.270874 5154 raft_consensus.cc:740] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.271734 5154 consensus_queue.cc:260] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.274385 5154 ts_tablet_manager.cc:1434] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20251215 20:54:05.275375 5154 tablet_bootstrap.cc:492] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.281658 5154 tablet_bootstrap.cc:654] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.286435 5156 tablet_bootstrap.cc:492] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.286810 5156 ts_tablet_manager.cc:1403] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.007s
I20251215 20:54:05.288797 5156 raft_consensus.cc:359] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.289454 5156 raft_consensus.cc:385] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.289736 5156 raft_consensus.cc:740] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.290385 5154 tablet_bootstrap.cc:492] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.290402 5156 consensus_queue.cc:260] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.291067 5154 ts_tablet_manager.cc:1403] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.005s
I20251215 20:54:05.292850 5156 ts_tablet_manager.cc:1434] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251215 20:54:05.295385 5156 tablet_bootstrap.cc:492] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.296247 5159 raft_consensus.cc:493] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.296743 5159 raft_consensus.cc:515] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.299073 5159 leader_election.cc:290] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:05.301139 5156 tablet_bootstrap.cc:654] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.305438 5165 raft_consensus.cc:493] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.305748 5157 tablet_bootstrap.cc:492] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.306273 5157 ts_tablet_manager.cc:1403] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.048s user 0.021s sys 0.026s
I20251215 20:54:05.305907 5165 raft_consensus.cc:515] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.309019 5157 raft_consensus.cc:359] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.309669 5157 raft_consensus.cc:385] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.309973 5157 raft_consensus.cc:740] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.310636 5157 consensus_queue.cc:260] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.312857 5157 ts_tablet_manager.cc:1434] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:54:05.313752 5156 tablet_bootstrap.cc:492] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.314319 5156 ts_tablet_manager.cc:1403] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.000s
I20251215 20:54:05.315448 5165 leader_election.cc:290] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.313745 5157 tablet_bootstrap.cc:492] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.322846 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
W20251215 20:54:05.324554 5080 leader_election.cc:343] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.329054 5157 tablet_bootstrap.cc:654] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.330154 5156 raft_consensus.cc:359] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.330890 5156 raft_consensus.cc:385] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.330691 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
W20251215 20:54:05.332163 5080 leader_election.cc:343] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.332667 5080 leader_election.cc:304] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d; no voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:05.333456 5159 raft_consensus.cc:2749] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:05.334367 5154 raft_consensus.cc:359] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.335112 5154 raft_consensus.cc:385] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.335391 5154 raft_consensus.cc:740] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.336097 5154 consensus_queue.cc:260] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.331223 5156 raft_consensus.cc:740] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.337393 5156 consensus_queue.cc:260] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.338395 5154 ts_tablet_manager.cc:1434] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.047s user 0.005s sys 0.001s
I20251215 20:54:05.339349 5154 tablet_bootstrap.cc:492] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.339917 5156 ts_tablet_manager.cc:1434] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.025s user 0.007s sys 0.001s
I20251215 20:54:05.340845 5156 tablet_bootstrap.cc:492] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.341149 5157 tablet_bootstrap.cc:492] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.341614 5157 ts_tablet_manager.cc:1403] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.003s
I20251215 20:54:05.344349 5157 raft_consensus.cc:359] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.345031 5157 raft_consensus.cc:385] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.345078 5154 tablet_bootstrap.cc:654] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.345368 5157 raft_consensus.cc:740] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.346154 5157 consensus_queue.cc:260] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.346634 5156 tablet_bootstrap.cc:654] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.351454 5157 ts_tablet_manager.cc:1434] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.010s user 0.007s sys 0.003s
I20251215 20:54:05.352550 5157 tablet_bootstrap.cc:492] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.357056 5154 tablet_bootstrap.cc:492] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.357528 5154 ts_tablet_manager.cc:1403] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20251215 20:54:05.358628 5157 tablet_bootstrap.cc:654] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.360101 5154 raft_consensus.cc:359] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.360845 5154 raft_consensus.cc:385] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.361121 5154 raft_consensus.cc:740] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.362506 5154 consensus_queue.cc:260] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.364467 5154 ts_tablet_manager.cc:1434] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251215 20:54:05.365417 5154 tablet_bootstrap.cc:492] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.368055 5156 tablet_bootstrap.cc:492] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.368605 5156 ts_tablet_manager.cc:1403] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.013s
I20251215 20:54:05.371493 5154 tablet_bootstrap.cc:654] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.371223 5156 raft_consensus.cc:359] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.372047 5156 raft_consensus.cc:385] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.372412 5156 raft_consensus.cc:740] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.372689 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.373322 5157 tablet_bootstrap.cc:492] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.373325 4965 raft_consensus.cc:2468] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:05.373193 5156 consensus_queue.cc:260] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.373950 5157 ts_tablet_manager.cc:1403] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.002s
I20251215 20:54:05.375905 5156 ts_tablet_manager.cc:1434] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20251215 20:54:05.376907 5156 tablet_bootstrap.cc:492] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.376765 5157 raft_consensus.cc:359] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.377467 5157 raft_consensus.cc:385] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.377764 5157 raft_consensus.cc:740] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.378407 5157 consensus_queue.cc:260] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.378814 5006 leader_election.cc:304] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.380959 5157 ts_tablet_manager.cc:1434] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20251215 20:54:05.381873 5157 tablet_bootstrap.cc:492] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.382706 5154 tablet_bootstrap.cc:492] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.383188 5154 ts_tablet_manager.cc:1403] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.004s
I20251215 20:54:05.385845 5154 raft_consensus.cc:359] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.386487 5154 raft_consensus.cc:385] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.386776 5154 raft_consensus.cc:740] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.386997 5165 raft_consensus.cc:2804] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.387348 5165 raft_consensus.cc:493] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.387658 5165 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.387550 5154 consensus_queue.cc:260] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.391835 5154 ts_tablet_manager.cc:1434] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251215 20:54:05.392809 5154 tablet_bootstrap.cc:492] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.394768 5165 raft_consensus.cc:515] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.396687 5165 leader_election.cc:290] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.387629 5157 tablet_bootstrap.cc:654] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.397541 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:05.398116 4965 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.398386 5154 tablet_bootstrap.cc:654] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.399817 5156 tablet_bootstrap.cc:654] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.409188 5154 tablet_bootstrap.cc:492] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.409731 5154 ts_tablet_manager.cc:1403] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.017s user 0.016s sys 0.000s
I20251215 20:54:05.410894 5165 raft_consensus.cc:493] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.411351 5165 raft_consensus.cc:515] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.412220 5154 raft_consensus.cc:359] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.412938 5154 raft_consensus.cc:385] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.413254 5165 leader_election.cc:290] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.413578 5154 raft_consensus.cc:740] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.414367 5154 consensus_queue.cc:260] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.414868 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95ebe2c267704faeb129378e03859d4f" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.415488 4964 raft_consensus.cc:2468] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:05.416486 5159 raft_consensus.cc:493] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.416659 5006 leader_election.cc:304] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.416970 5159 raft_consensus.cc:515] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.417742 5165 raft_consensus.cc:2804] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.418097 5165 raft_consensus.cc:493] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.418413 5165 raft_consensus.cc:3060] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.418746 5159 leader_election.cc:290] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:05.420643 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
W20251215 20:54:05.421901 5080 leader_election.cc:343] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.423009 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
W20251215 20:54:05.424228 5080 leader_election.cc:343] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.424664 5080 leader_election.cc:304] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d; no voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:05.425348 5159 raft_consensus.cc:2749] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:05.426177 5154 ts_tablet_manager.cc:1434] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20251215 20:54:05.427326 5154 tablet_bootstrap.cc:492] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.435379 5154 tablet_bootstrap.cc:654] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.440618 5165 raft_consensus.cc:515] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.440801 5114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:05.437781 4965 raft_consensus.cc:2468] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.441741 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95ebe2c267704faeb129378e03859d4f" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:05.441936 5114 raft_consensus.cc:2468] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:05.441768 5113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:05.442545 5112 raft_consensus.cc:2468] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:05.442662 5113 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.444406 5165 leader_election.cc:290] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.442394 5006 leader_election.cc:304] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.445624 5165 raft_consensus.cc:2804] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.448369 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95ebe2c267704faeb129378e03859d4f" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:05.448913 5112 raft_consensus.cc:3060] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.449249 5156 tablet_bootstrap.cc:492] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.448043 5165 raft_consensus.cc:697] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:05.449892 5156 ts_tablet_manager.cc:1403] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.073s user 0.017s sys 0.032s
I20251215 20:54:05.450598 5165 consensus_queue.cc:237] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.452556 5156 raft_consensus.cc:359] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.453226 5156 raft_consensus.cc:385] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.453502 5156 raft_consensus.cc:740] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.447093 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95ebe2c267704faeb129378e03859d4f" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:05.454160 5156 consensus_queue.cc:260] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.455453 4965 raft_consensus.cc:3060] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.459350 5113 raft_consensus.cc:2468] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.469303 5157 tablet_bootstrap.cc:492] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.469800 5157 ts_tablet_manager.cc:1403] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.088s user 0.019s sys 0.029s
I20251215 20:54:05.469676 5112 raft_consensus.cc:2468] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.472465 5005 leader_election.cc:304] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:05.473351 5165 raft_consensus.cc:2804] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.475476 5154 tablet_bootstrap.cc:492] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.475982 5154 ts_tablet_manager.cc:1403] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.006s
I20251215 20:54:05.472963 4860 catalog_manager.cc:5654] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:05.479444 5156 ts_tablet_manager.cc:1434] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.029s user 0.013s sys 0.011s
I20251215 20:54:05.474875 5165 raft_consensus.cc:697] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:05.480501 5156 tablet_bootstrap.cc:492] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.480326 5165 consensus_queue.cc:237] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.480492 5154 raft_consensus.cc:359] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.477349 5183 raft_consensus.cc:493] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.481307 5154 raft_consensus.cc:385] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.479548 5157 raft_consensus.cc:359] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.484613 5154 raft_consensus.cc:740] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.484701 5157 raft_consensus.cc:385] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.485385 5157 raft_consensus.cc:740] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.485776 5156 tablet_bootstrap.cc:654] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.485383 5154 consensus_queue.cc:260] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.484805 5183 raft_consensus.cc:515] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.486344 5157 consensus_queue.cc:260] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.489576 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.490159 5154 ts_tablet_manager.cc:1434] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20251215 20:54:05.491163 5154 tablet_bootstrap.cc:492] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:05.490126 4964 raft_consensus.cc:2468] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:05.493419 5006 leader_election.cc:304] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.495107 5165 raft_consensus.cc:2804] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.495477 5165 raft_consensus.cc:493] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.495860 5165 raft_consensus.cc:3060] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.496415 5154 tablet_bootstrap.cc:654] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.499823 5161 raft_consensus.cc:493] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.500284 5161 raft_consensus.cc:515] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.502774 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:05.503742 5161 leader_election.cc:290] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
W20251215 20:54:05.504403 5005 leader_election.cc:343] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.507158 5165 raft_consensus.cc:515] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.517243 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:05.517804 4964 raft_consensus.cc:3060] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.523660 5157 ts_tablet_manager.cc:1434] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.053s user 0.004s sys 0.003s
I20251215 20:54:05.508050 5183 leader_election.cc:290] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.525172 4964 raft_consensus.cc:2468] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.526405 5006 leader_election.cc:304] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.527427 5183 raft_consensus.cc:2804] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.527944 5183 raft_consensus.cc:697] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:05.528786 5183 consensus_queue.cc:237] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.510357 4965 raft_consensus.cc:2468] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.532972 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
W20251215 20:54:05.534219 5005 leader_election.cc:343] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.536623 5165 leader_election.cc:290] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.525218 5157 tablet_bootstrap.cc:492] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.540283 5156 tablet_bootstrap.cc:492] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.540861 5156 ts_tablet_manager.cc:1403] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.061s user 0.020s sys 0.039s
I20251215 20:54:05.543641 5156 raft_consensus.cc:359] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.544313 5156 raft_consensus.cc:385] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 20:54:05.544683 4910 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:54:05.544648 5156 raft_consensus.cc:740] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.545670 5156 consensus_queue.cc:260] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.548413 5156 ts_tablet_manager.cc:1434] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251215 20:54:05.549427 5156 tablet_bootstrap.cc:492] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.554301 5157 tablet_bootstrap.cc:654] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.555287 5156 tablet_bootstrap.cc:654] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.568599 5161 raft_consensus.cc:493] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.569190 5161 raft_consensus.cc:515] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.571156 5161 leader_election.cc:290] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.575932 5156 tablet_bootstrap.cc:492] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.576571 5156 ts_tablet_manager.cc:1403] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.007s
I20251215 20:54:05.579401 5156 raft_consensus.cc:359] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.580250 5156 raft_consensus.cc:385] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.580610 5156 raft_consensus.cc:740] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.581372 5156 consensus_queue.cc:260] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.584057 5156 ts_tablet_manager.cc:1434] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:54:05.585155 5156 tablet_bootstrap.cc:492] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.591424 5156 tablet_bootstrap.cc:654] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.594267 4860 catalog_manager.cc:5654] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:05.596896 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9e71d96233a4ebd99e5927a05efdd45" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:05.597538 5112 raft_consensus.cc:2468] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 0.
I20251215 20:54:05.597246 4860 catalog_manager.cc:5654] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:05.599275 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:05.599853 5112 raft_consensus.cc:2468] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 0.
I20251215 20:54:05.601044 4930 leader_election.cc:304] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.601136 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9e71d96233a4ebd99e5927a05efdd45" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:05.601799 5161 raft_consensus.cc:2804] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.601841 5040 raft_consensus.cc:2468] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 0.
I20251215 20:54:05.602284 5161 raft_consensus.cc:493] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.602682 5161 raft_consensus.cc:3060] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.602756 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
W20251215 20:54:05.605172 4931 leader_election.cc:343] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.605931 4930 leader_election.cc:304] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters: 7adbc795f55441b6bccad811ca6f95c6
I20251215 20:54:05.609246 5156 tablet_bootstrap.cc:492] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.609603 5161 raft_consensus.cc:515] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.610249 5157 tablet_bootstrap.cc:492] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.610695 5156 ts_tablet_manager.cc:1403] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.007s
I20251215 20:54:05.610826 5154 tablet_bootstrap.cc:492] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:05.611264 5154 ts_tablet_manager.cc:1403] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.120s user 0.042s sys 0.065s
I20251215 20:54:05.610736 5157 ts_tablet_manager.cc:1403] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.007s
I20251215 20:54:05.612339 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9e71d96233a4ebd99e5927a05efdd45" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:05.612964 5039 raft_consensus.cc:3060] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.613708 5154 raft_consensus.cc:359] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.614327 5154 raft_consensus.cc:385] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.614593 5154 raft_consensus.cc:740] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.615298 5154 consensus_queue.cc:260] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.616415 5156 raft_consensus.cc:359] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.617255 5156 raft_consensus.cc:385] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.617563 5156 raft_consensus.cc:740] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.617815 5154 ts_tablet_manager.cc:1434] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20251215 20:54:05.610050 5199 raft_consensus.cc:2804] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.618180 5199 raft_consensus.cc:493] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.618531 5199 raft_consensus.cc:3060] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.619390 5161 leader_election.cc:290] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.620033 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9e71d96233a4ebd99e5927a05efdd45" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:05.620606 5112 raft_consensus.cc:3060] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.620558 5159 raft_consensus.cc:493] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.621284 5159 raft_consensus.cc:515] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.622350 5039 raft_consensus.cc:2468] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 1.
I20251215 20:54:05.623059 5159 leader_election.cc:290] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:05.623709 4931 leader_election.cc:304] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.624548 5161 raft_consensus.cc:2804] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.625236 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e4d9d75a8b8414091c31038c21d0405" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.625849 4965 raft_consensus.cc:2468] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:05.625949 5156 consensus_queue.cc:260] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.626842 5080 leader_election.cc:304] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.615808 5157 raft_consensus.cc:359] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.629012 5157 raft_consensus.cc:385] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.629302 5156 ts_tablet_manager.cc:1434] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.018s user 0.001s sys 0.004s
I20251215 20:54:05.629333 5157 raft_consensus.cc:740] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.629885 5159 raft_consensus.cc:2804] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.630270 5159 raft_consensus.cc:493] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.630364 5156 tablet_bootstrap.cc:492] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:05.630375 5157 consensus_queue.cc:260] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.632781 5199 raft_consensus.cc:515] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.633775 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e4d9d75a8b8414091c31038c21d0405" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:05.634382 5039 raft_consensus.cc:2468] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:05.635464 5156 tablet_bootstrap.cc:654] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.635440 5199 leader_election.cc:290] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.636600 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:05.636606 5113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:05.638090 5113 raft_consensus.cc:3060] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:54:05.638703 4931 leader_election.cc:343] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.644724 5113 raft_consensus.cc:2468] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 1.
I20251215 20:54:05.645792 4930 leader_election.cc:304] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters: 7adbc795f55441b6bccad811ca6f95c6
I20251215 20:54:05.646868 5199 raft_consensus.cc:2804] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.647295 5199 raft_consensus.cc:697] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:05.648066 5159 raft_consensus.cc:3060] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.648047 5199 consensus_queue.cc:237] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.633122 5112 raft_consensus.cc:2468] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 1.
I20251215 20:54:05.655483 5159 raft_consensus.cc:515] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.658224 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e4d9d75a8b8414091c31038c21d0405" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:05.658825 4965 raft_consensus.cc:3060] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.665637 4965 raft_consensus.cc:2468] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 1.
I20251215 20:54:05.666769 5080 leader_election.cc:304] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.682886 5203 raft_consensus.cc:2804] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.684126 5161 raft_consensus.cc:697] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:05.685153 5161 consensus_queue.cc:237] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.689762 5159 leader_election.cc:290] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:05.689843 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e4d9d75a8b8414091c31038c21d0405" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:05.690557 5039 raft_consensus.cc:3060] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.695151 5203 raft_consensus.cc:697] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:05.696015 5203 consensus_queue.cc:237] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.697242 5039 raft_consensus.cc:2468] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 1.
I20251215 20:54:05.699628 5157 ts_tablet_manager.cc:1434] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.088s user 0.019s sys 0.048s
I20251215 20:54:05.700855 5157 tablet_bootstrap.cc:492] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.704836 5156 tablet_bootstrap.cc:492] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:05.705312 5156 ts_tablet_manager.cc:1403] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.075s user 0.030s sys 0.043s
I20251215 20:54:05.706712 5157 tablet_bootstrap.cc:654] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.707836 5156 raft_consensus.cc:359] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.708549 5156 raft_consensus.cc:385] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.708801 5156 raft_consensus.cc:740] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.709493 5156 consensus_queue.cc:260] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.711843 5183 raft_consensus.cc:493] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.712339 5183 raft_consensus.cc:515] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.712659 4863 catalog_manager.cc:5654] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 0 to 1, leader changed from <none> to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 1 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:05.714329 5183 leader_election.cc:290] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.715032 4860 catalog_manager.cc:5654] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 0 to 1, leader changed from <none> to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 1 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:05.717016 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:05.717623 5112 raft_consensus.cc:2468] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:05.718762 5005 leader_election.cc:304] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:05.719844 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.720992 5156 ts_tablet_manager.cc:1434] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20251215 20:54:05.721177 5183 raft_consensus.cc:2804] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.721607 5183 raft_consensus.cc:493] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.721917 5183 raft_consensus.cc:3060] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:54:05.724344 5006 leader_election.cc:343] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:05.725589 5157 tablet_bootstrap.cc:492] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.726039 5157 ts_tablet_manager.cc:1403] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.012s
I20251215 20:54:05.728331 5157 raft_consensus.cc:359] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.728909 5157 raft_consensus.cc:385] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.729157 5157 raft_consensus.cc:740] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.729652 5157 consensus_queue.cc:260] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.730994 5157 ts_tablet_manager.cc:1434] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251215 20:54:05.731812 5157 tablet_bootstrap.cc:492] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:05.732153 5183 raft_consensus.cc:515] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.735594 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:05.736150 5157 tablet_bootstrap.cc:654] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:05.735550 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:05.736271 4965 raft_consensus.cc:3060] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.736665 5112 raft_consensus.cc:3060] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.736001 5203 raft_consensus.cc:493] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.738292 5203 raft_consensus.cc:515] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.740067 5183 leader_election.cc:290] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.740252 5203 leader_election.cc:290] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:05.742017 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f89ce175118468590c163a82684f58d" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.742251 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f89ce175118468590c163a82684f58d" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:05.742640 4964 raft_consensus.cc:2468] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:05.742899 5157 tablet_bootstrap.cc:492] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:05.743183 4965 raft_consensus.cc:2468] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.743413 5157 ts_tablet_manager.cc:1403] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20251215 20:54:05.743857 5080 leader_election.cc:304] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.744966 5006 leader_election.cc:304] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.745757 5183 raft_consensus.cc:2804] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.745736 5157 raft_consensus.cc:359] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.746342 5183 raft_consensus.cc:697] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:05.746484 5157 raft_consensus.cc:385] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:05.746780 5157 raft_consensus.cc:740] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:05.747184 5183 consensus_queue.cc:237] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.747561 5112 raft_consensus.cc:2468] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.747416 5157 consensus_queue.cc:260] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.749125 5203 raft_consensus.cc:2804] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.749487 5203 raft_consensus.cc:493] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.742830 5039 raft_consensus.cc:2468] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:05.749807 5203 raft_consensus.cc:3060] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.753142 4863 catalog_manager.cc:5654] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 0 to 1, leader changed from <none> to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 1 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:05.749800 5157 ts_tablet_manager.cc:1434] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20251215 20:54:05.756702 4862 catalog_manager.cc:5654] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:05.759675 5203 raft_consensus.cc:515] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.762295 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f89ce175118468590c163a82684f58d" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:05.762833 4965 raft_consensus.cc:3060] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.762936 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f89ce175118468590c163a82684f58d" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:05.763535 5039 raft_consensus.cc:3060] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.768646 4965 raft_consensus.cc:2468] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 1.
I20251215 20:54:05.769297 5203 leader_election.cc:290] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:05.769716 5080 leader_election.cc:304] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:05.770174 5039 raft_consensus.cc:2468] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 1.
I20251215 20:54:05.770464 5203 raft_consensus.cc:2804] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.770978 5203 raft_consensus.cc:697] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:05.771644 5203 consensus_queue.cc:237] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.777961 4862 catalog_manager.cc:5654] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 0 to 1, leader changed from <none> to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 1 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:05.785269 5183 raft_consensus.cc:493] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.785827 5183 raft_consensus.cc:515] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.787703 5183 leader_election.cc:290] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.788271 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.788604 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:05.789309 5112 raft_consensus.cc:2393] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7adbc795f55441b6bccad811ca6f95c6 in current term 1: Already voted for candidate c1d56ae93a9e42e0b257f491deb526ae in this term.
I20251215 20:54:05.789971 5005 leader_election.cc:304] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6; no voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:05.790540 5183 raft_consensus.cc:3060] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.794922 5183 raft_consensus.cc:2749] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:05.854131 5183 raft_consensus.cc:493] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.854557 5183 raft_consensus.cc:515] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.856040 5183 leader_election.cc:290] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.856786 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.856992 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:05.857532 4965 raft_consensus.cc:2468] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:05.857537 5112 raft_consensus.cc:2468] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:05.858608 5005 leader_election.cc:304] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:05.859184 5183 raft_consensus.cc:2804] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:05.859449 5183 raft_consensus.cc:493] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:05.859685 5183 raft_consensus.cc:3060] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.864248 5165 consensus_queue.cc:1048] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:05.864678 5183 raft_consensus.cc:515] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.866329 5183 leader_election.cc:290] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:05.867120 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:05.867313 5113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:05.867753 4965 raft_consensus.cc:3060] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.867895 5113 raft_consensus.cc:3060] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.874562 5113 raft_consensus.cc:2468] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.874652 4965 raft_consensus.cc:2468] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:05.875505 5005 leader_election.cc:304] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:05.876251 5183 raft_consensus.cc:2804] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:05.876734 5183 raft_consensus.cc:697] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:05.877502 5183 consensus_queue.cc:237] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.881103 5186 consensus_queue.cc:1048] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:54:05.884542 5203 raft_consensus.cc:493] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:05.885107 5203 raft_consensus.cc:515] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:05.887887 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:05.888008 4863 catalog_manager.cc:5654] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:05.888725 4964 raft_consensus.cc:2393] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 112ac20bd86a4be9a90456833a5c664d in current term 1: Already voted for candidate 7adbc795f55441b6bccad811ca6f95c6 in this term.
I20251215 20:54:05.890084 5203 leader_election.cc:290] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:05.892114 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:05.893508 5080 leader_election.cc:304] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d; no voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:05.894235 5203 raft_consensus.cc:3060] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:05.898269 5183 consensus_queue.cc:1048] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:05.900787 5203 raft_consensus.cc:2749] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:05.910218 5186 consensus_queue.cc:1048] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:05.962139 5113 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0e4d9d75a8b8414091c31038c21d0405"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
mode: GRACEFUL
new_leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:46868
I20251215 20:54:05.962611 5113 raft_consensus.cc:606] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Received request to transfer leadership to TS c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:05.972987 5039 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
mode: GRACEFUL
new_leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:36960
I20251215 20:54:05.973448 5039 raft_consensus.cc:606] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Received request to transfer leadership to TS c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:05.977638 5039 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "95ebe2c267704faeb129378e03859d4f"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
mode: GRACEFUL
new_leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:36960
I20251215 20:54:05.978098 5039 raft_consensus.cc:606] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Received request to transfer leadership to TS c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:05.981932 5039 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
mode: GRACEFUL
new_leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:36960
I20251215 20:54:05.982333 5039 raft_consensus.cc:606] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Received request to transfer leadership to TS c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:05.993412 4965 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
mode: GRACEFUL
new_leader_uuid: "7adbc795f55441b6bccad811ca6f95c6"
from {username='slave'} at 127.0.0.1:53214
I20251215 20:54:05.993862 4965 raft_consensus.cc:606] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Received request to transfer leadership to TS 7adbc795f55441b6bccad811ca6f95c6
I20251215 20:54:05.998131 5113 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "8f89ce175118468590c163a82684f58d"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
mode: GRACEFUL
new_leader_uuid: "7adbc795f55441b6bccad811ca6f95c6"
from {username='slave'} at 127.0.0.1:46868
I20251215 20:54:05.998564 5113 raft_consensus.cc:606] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Received request to transfer leadership to TS 7adbc795f55441b6bccad811ca6f95c6
I20251215 20:54:06.004930 4965 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9e71d96233a4ebd99e5927a05efdd45"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
mode: GRACEFUL
new_leader_uuid: "7adbc795f55441b6bccad811ca6f95c6"
from {username='slave'} at 127.0.0.1:53214
I20251215 20:54:06.005386 4965 raft_consensus.cc:606] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Received request to transfer leadership to TS 7adbc795f55441b6bccad811ca6f95c6
I20251215 20:54:06.009455 5039 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
mode: GRACEFUL
new_leader_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:36960
I20251215 20:54:06.009902 5039 raft_consensus.cc:606] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Received request to transfer leadership to TS 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:06.071668 5186 consensus_queue.cc:1048] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.077339 5183 raft_consensus.cc:993] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6: : Instructing follower 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:06.077906 5165 raft_consensus.cc:1081] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Signalling peer 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:06.079433 5112 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:46838
I20251215 20:54:06.080037 5112 raft_consensus.cc:493] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:06.080425 5112 raft_consensus.cc:3060] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.083431 5165 consensus_queue.cc:1048] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.086295 5112 raft_consensus.cc:515] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.089620 5112 leader_election.cc:290] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 2 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:06.091621 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:06.092236 5039 raft_consensus.cc:3055] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:06.092413 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4609948393fc4c0a98313eddb4c52917" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:06.092852 5039 raft_consensus.cc:740] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:06.093040 4964 raft_consensus.cc:3060] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.093624 5039 consensus_queue.cc:260] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.094887 5039 raft_consensus.cc:3060] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.099327 4964 raft_consensus.cc:2468] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 2.
I20251215 20:54:06.099880 5039 raft_consensus.cc:2468] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 2.
I20251215 20:54:06.100886 5080 leader_election.cc:304] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:06.101527 5203 raft_consensus.cc:2804] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:06.102005 5203 raft_consensus.cc:697] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 2 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:06.102751 5203 consensus_queue.cc:237] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.108386 4862 catalog_manager.cc:5654] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 1 to 2, leader changed from 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130) to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 2 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:06.117098 5161 consensus_queue.cc:1048] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.122424 5200 raft_consensus.cc:993] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae: : Instructing follower 7adbc795f55441b6bccad811ca6f95c6 to start an election
I20251215 20:54:06.122861 5199 raft_consensus.cc:1081] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Signalling peer 7adbc795f55441b6bccad811ca6f95c6 to start an election
I20251215 20:54:06.127611 5039 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
from {username='slave'} at 127.0.0.1:36948
I20251215 20:54:06.128120 5039 raft_consensus.cc:493] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:06.128508 5039 raft_consensus.cc:3060] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.129125 5199 consensus_queue.cc:1048] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.134619 5039 raft_consensus.cc:515] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.137202 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:06.137742 4964 raft_consensus.cc:3055] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:06.137861 5039 leader_election.cc:290] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 2 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:06.138181 4964 raft_consensus.cc:740] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:06.137915 5113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f9bc5301f3f4050a2453e0f7f8d6346" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:06.139031 4964 consensus_queue.cc:260] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.139909 4964 raft_consensus.cc:3060] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.145093 4964 raft_consensus.cc:2468] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 2.
I20251215 20:54:06.145895 5006 leader_election.cc:304] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters: 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:06.146615 5165 raft_consensus.cc:2804] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:06.146978 5165 raft_consensus.cc:697] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:06.147697 5203 consensus_queue.cc:1048] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.147620 5165 consensus_queue.cc:237] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.152321 5199 consensus_queue.cc:1048] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.155066 4862 catalog_manager.cc:5654] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 1 to 2, leader changed from c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129) to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:06.162545 5199 consensus_queue.cc:1048] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.169822 5159 consensus_queue.cc:1048] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.173194 5204 raft_consensus.cc:993] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae: : Instructing follower 7adbc795f55441b6bccad811ca6f95c6 to start an election
I20251215 20:54:06.173619 5204 raft_consensus.cc:1081] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Signalling peer 7adbc795f55441b6bccad811ca6f95c6 to start an election
I20251215 20:54:06.178329 5159 raft_consensus.cc:993] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d: : Instructing follower c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:06.178718 5159 raft_consensus.cc:1081] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Signalling peer c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:06.178951 5040 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9e71d96233a4ebd99e5927a05efdd45"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
from {username='slave'} at 127.0.0.1:36948
I20251215 20:54:06.179534 5040 raft_consensus.cc:493] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:06.179860 5040 raft_consensus.cc:3060] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.180256 4964 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0e4d9d75a8b8414091c31038c21d0405"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:53208
I20251215 20:54:06.180831 4964 raft_consensus.cc:493] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:06.181100 4964 raft_consensus.cc:3060] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.185806 5040 raft_consensus.cc:515] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.185832 4964 raft_consensus.cc:515] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.187804 4964 leader_election.cc:290] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:06.188206 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e4d9d75a8b8414091c31038c21d0405" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:06.188714 5039 raft_consensus.cc:3060] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.188756 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e4d9d75a8b8414091c31038c21d0405" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:06.189437 5112 raft_consensus.cc:3055] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:06.188756 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9e71d96233a4ebd99e5927a05efdd45" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:06.189826 5112 raft_consensus.cc:740] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:06.190043 4965 raft_consensus.cc:3055] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:06.190346 4965 raft_consensus.cc:740] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:06.190606 5112 consensus_queue.cc:260] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.191054 4965 consensus_queue.cc:260] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.191890 5112 raft_consensus.cc:3060] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.192078 4965 raft_consensus.cc:3060] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.195585 5203 consensus_queue.cc:1048] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.196406 5039 raft_consensus.cc:2468] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:06.197444 4931 leader_election.cc:304] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:06.198050 5199 raft_consensus.cc:2804] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:06.198411 5112 raft_consensus.cc:2468] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:06.198532 5199 raft_consensus.cc:697] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:06.199504 5199 consensus_queue.cc:237] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.200769 5040 leader_election.cc:290] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 2 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:06.200484 4965 raft_consensus.cc:2468] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 2.
I20251215 20:54:06.202314 5006 leader_election.cc:304] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:06.202332 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9e71d96233a4ebd99e5927a05efdd45" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:06.203038 5112 raft_consensus.cc:3060] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.203250 5186 raft_consensus.cc:2804] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:06.203759 5186 raft_consensus.cc:697] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:06.204563 5186 consensus_queue.cc:237] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.211167 5112 raft_consensus.cc:2468] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 2.
I20251215 20:54:06.211024 4862 catalog_manager.cc:5654] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 1 to 2, leader changed from 112ac20bd86a4be9a90456833a5c664d (127.0.106.131) to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 2 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:06.213696 5205 raft_consensus.cc:993] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d: : Instructing follower 7adbc795f55441b6bccad811ca6f95c6 to start an election
I20251215 20:54:06.214098 5205 raft_consensus.cc:1081] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Signalling peer 7adbc795f55441b6bccad811ca6f95c6 to start an election
I20251215 20:54:06.219100 5205 consensus_queue.cc:1048] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.218415 5040 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "8f89ce175118468590c163a82684f58d"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
from {username='slave'} at 127.0.0.1:36936
I20251215 20:54:06.220047 5040 raft_consensus.cc:493] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:06.220432 5040 raft_consensus.cc:3060] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.226099 5040 raft_consensus.cc:515] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.228547 5040 leader_election.cc:290] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 2 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:06.229616 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f89ce175118468590c163a82684f58d" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:06.230221 5112 raft_consensus.cc:3055] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:06.230527 5112 raft_consensus.cc:740] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:06.230891 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f89ce175118468590c163a82684f58d" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:06.231348 4965 raft_consensus.cc:3060] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.231251 5112 consensus_queue.cc:260] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.232646 5112 raft_consensus.cc:3060] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.232518 4863 catalog_manager.cc:5654] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 1 to 2, leader changed from c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129) to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:06.235982 4965 raft_consensus.cc:2468] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 2.
I20251215 20:54:06.237105 5006 leader_election.cc:304] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:06.238051 5186 raft_consensus.cc:2804] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:06.238483 5186 raft_consensus.cc:697] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:06.239233 5186 consensus_queue.cc:237] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.240602 5112 raft_consensus.cc:2468] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 2.
I20251215 20:54:06.248379 4862 catalog_manager.cc:5654] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 1 to 2, leader changed from 112ac20bd86a4be9a90456833a5c664d (127.0.106.131) to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:06.306118 5186 consensus_queue.cc:1048] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.311462 5165 raft_consensus.cc:993] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6: : Instructing follower c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:06.311916 5183 raft_consensus.cc:1081] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Signalling peer c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:06.313381 4964 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:53212
I20251215 20:54:06.314990 4964 raft_consensus.cc:493] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:06.315366 4964 raft_consensus.cc:3060] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.315840 5186 consensus_queue.cc:1048] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.322072 4964 raft_consensus.cc:515] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.329212 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:06.329449 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3baa177654f34e04a16b0024a32bcbb2" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:06.329773 5040 raft_consensus.cc:3055] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:06.329996 5112 raft_consensus.cc:3060] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.330163 5040 raft_consensus.cc:740] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:06.331020 5040 consensus_queue.cc:260] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.332062 5040 raft_consensus.cc:3060] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.335413 5112 raft_consensus.cc:2468] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:06.336408 4964 leader_election.cc:290] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:06.336851 5040 raft_consensus.cc:2468] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:06.337785 4930 leader_election.cc:304] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:06.338421 5199 raft_consensus.cc:2804] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:06.338868 5199 raft_consensus.cc:697] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:06.339582 5199 consensus_queue.cc:237] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.344766 4862 catalog_manager.cc:5654] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 1 to 2, leader changed from 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130) to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 2 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:06.391124 5183 consensus_queue.cc:1048] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.401026 5186 consensus_queue.cc:1048] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:06.448942 5183 raft_consensus.cc:993] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6: : Instructing follower c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:06.449313 5186 raft_consensus.cc:1081] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Signalling peer c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:06.450578 4964 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:53212
I20251215 20:54:06.451045 4964 raft_consensus.cc:493] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:06.451326 4964 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.455716 4964 raft_consensus.cc:515] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.457098 4964 leader_election.cc:290] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:06.457748 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:06.458113 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:06.458241 5040 raft_consensus.cc:3055] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:06.458598 5112 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.458643 5040 raft_consensus.cc:740] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:06.459506 5040 consensus_queue.cc:260] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.460716 5040 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.463361 5112 raft_consensus.cc:2468] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:06.464277 4930 leader_election.cc:304] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:06.464913 5199 raft_consensus.cc:2804] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:06.465375 5199 raft_consensus.cc:697] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:06.465788 5040 raft_consensus.cc:2468] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:06.466157 5199 consensus_queue.cc:237] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.471952 4863 catalog_manager.cc:5654] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 1 to 2, leader changed from 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130) to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 2 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:06.475121 5183 raft_consensus.cc:993] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6: : Instructing follower c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:06.475577 5186 raft_consensus.cc:1081] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Signalling peer c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:06.477046 4964 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "95ebe2c267704faeb129378e03859d4f"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:53212
I20251215 20:54:06.477545 4964 raft_consensus.cc:493] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:06.477887 4964 raft_consensus.cc:3060] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.483017 4964 raft_consensus.cc:515] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.484403 4964 leader_election.cc:290] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:06.485037 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95ebe2c267704faeb129378e03859d4f" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:06.485292 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95ebe2c267704faeb129378e03859d4f" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:06.485628 5040 raft_consensus.cc:3055] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:06.485806 5112 raft_consensus.cc:3060] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.485994 5040 raft_consensus.cc:740] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:06.486790 5040 consensus_queue.cc:260] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.487955 5040 raft_consensus.cc:3060] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.492250 5112 raft_consensus.cc:2468] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:06.493368 4930 leader_election.cc:304] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:06.494118 5199 raft_consensus.cc:2804] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:06.494316 5040 raft_consensus.cc:2468] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:06.494477 5199 raft_consensus.cc:697] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:06.495291 5199 consensus_queue.cc:237] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:06.500743 4863 catalog_manager.cc:5654] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 1 to 2, leader changed from 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130) to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 2 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:06.579463 5040 raft_consensus.cc:1275] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.580498 5199 consensus_queue.cc:1048] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.587203 5112 raft_consensus.cc:1275] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.588701 5204 consensus_queue.cc:1048] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.604394 4964 raft_consensus.cc:1275] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.605324 5205 consensus_queue.cc:1048] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.609244 5112 raft_consensus.cc:1275] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer 7adbc795f55441b6bccad811ca6f95c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.611277 5186 consensus_queue.cc:1048] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.611621 5040 raft_consensus.cc:1275] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.613183 5159 consensus_queue.cc:1048] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.622676 4964 raft_consensus.cc:1275] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Refusing update from remote peer 7adbc795f55441b6bccad811ca6f95c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.624068 5185 consensus_queue.cc:1048] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.652667 5112 raft_consensus.cc:1275] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer 7adbc795f55441b6bccad811ca6f95c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.653628 5185 consensus_queue.cc:1048] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.660058 4964 raft_consensus.cc:1275] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Refusing update from remote peer 7adbc795f55441b6bccad811ca6f95c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.661320 5183 consensus_queue.cc:1048] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.698596 5112 raft_consensus.cc:3060] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:06.703321 5112 raft_consensus.cc:1275] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer 7adbc795f55441b6bccad811ca6f95c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.704411 5183 consensus_queue.cc:1048] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.710938 4964 raft_consensus.cc:1275] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Refusing update from remote peer 7adbc795f55441b6bccad811ca6f95c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.712472 5186 consensus_queue.cc:1048] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.738687 5112 raft_consensus.cc:1275] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.739733 5204 consensus_queue.cc:1048] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.746156 5040 raft_consensus.cc:1275] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.747650 5199 consensus_queue.cc:1048] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.930694 5040 raft_consensus.cc:1275] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.931701 5199 consensus_queue.cc:1048] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.939043 5112 raft_consensus.cc:1275] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.940344 5199 consensus_queue.cc:1048] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.973649 5112 raft_consensus.cc:1275] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.974731 5199 consensus_queue.cc:1048] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:06.982549 5040 raft_consensus.cc:1275] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:06.983948 5161 consensus_queue.cc:1048] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:09.011052 426 test_util.cc:276] Using random seed: -805066417
I20251215 20:54:09.033281 4862 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45508:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 20:54:09.035287 4862 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 20:54:09.079552 4953 tablet_service.cc:1505] Processing CreateTablet for tablet ed719c77ae6b42f98c1e11fdfaa4a86d (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:09.080698 4953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed719c77ae6b42f98c1e11fdfaa4a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.080799 5030 tablet_service.cc:1505] Processing CreateTablet for tablet ed719c77ae6b42f98c1e11fdfaa4a86d (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:09.082006 5030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed719c77ae6b42f98c1e11fdfaa4a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.083257 4950 tablet_service.cc:1505] Processing CreateTablet for tablet a95f03f628c6421ba58a7ae937e1c539 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:09.084678 5104 tablet_service.cc:1505] Processing CreateTablet for tablet a95f03f628c6421ba58a7ae937e1c539 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:09.085119 5026 tablet_service.cc:1505] Processing CreateTablet for tablet a95f03f628c6421ba58a7ae937e1c539 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:09.085886 5104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95f03f628c6421ba58a7ae937e1c539. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.086323 5026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95f03f628c6421ba58a7ae937e1c539. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.089174 4949 tablet_service.cc:1505] Processing CreateTablet for tablet 415472a9bc7f4f0986c06200eeb8da12 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:09.089926 5100 tablet_service.cc:1505] Processing CreateTablet for tablet 415472a9bc7f4f0986c06200eeb8da12 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:09.091089 5100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415472a9bc7f4f0986c06200eeb8da12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.081846 5103 tablet_service.cc:1505] Processing CreateTablet for tablet ed719c77ae6b42f98c1e11fdfaa4a86d (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:09.092061 5103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed719c77ae6b42f98c1e11fdfaa4a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.093578 5025 tablet_service.cc:1505] Processing CreateTablet for tablet 415472a9bc7f4f0986c06200eeb8da12 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:09.094727 5025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415472a9bc7f4f0986c06200eeb8da12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.097182 4947 tablet_service.cc:1505] Processing CreateTablet for tablet 8c9900d3933a4ba79c7753485e3754d4 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:09.097932 4951 tablet_service.cc:1505] Processing CreateTablet for tablet 778311f17c024c54800fdcd286efffbc (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:09.091177 4954 tablet_service.cc:1505] Processing CreateTablet for tablet b4fa4ed1647f4a28ac1de074ee2e7b5e (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:09.099152 4951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778311f17c024c54800fdcd286efffbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.099603 5098 tablet_service.cc:1505] Processing CreateTablet for tablet b4fa4ed1647f4a28ac1de074ee2e7b5e (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:09.100941 4950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95f03f628c6421ba58a7ae937e1c539. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.101267 5098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fa4ed1647f4a28ac1de074ee2e7b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.100131 5101 tablet_service.cc:1505] Processing CreateTablet for tablet 8c9900d3933a4ba79c7753485e3754d4 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:09.102344 5101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9900d3933a4ba79c7753485e3754d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.097191 5028 tablet_service.cc:1505] Processing CreateTablet for tablet b4fa4ed1647f4a28ac1de074ee2e7b5e (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:09.103987 5028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fa4ed1647f4a28ac1de074ee2e7b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.104589 4947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9900d3933a4ba79c7753485e3754d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.106787 5024 tablet_service.cc:1505] Processing CreateTablet for tablet 8c9900d3933a4ba79c7753485e3754d4 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:09.107990 5024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9900d3933a4ba79c7753485e3754d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.109787 4949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415472a9bc7f4f0986c06200eeb8da12. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.113608 4954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fa4ed1647f4a28ac1de074ee2e7b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.120904 5099 tablet_service.cc:1505] Processing CreateTablet for tablet 778311f17c024c54800fdcd286efffbc (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:09.122107 5099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778311f17c024c54800fdcd286efffbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.125537 5023 tablet_service.cc:1505] Processing CreateTablet for tablet 778311f17c024c54800fdcd286efffbc (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:09.126729 5023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778311f17c024c54800fdcd286efffbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.142027 4952 tablet_service.cc:1505] Processing CreateTablet for tablet 5f941295517b416faf90ed92f6a86731 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:09.143319 4952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f941295517b416faf90ed92f6a86731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.143420 5022 tablet_service.cc:1505] Processing CreateTablet for tablet 5f941295517b416faf90ed92f6a86731 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:09.144797 5022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f941295517b416faf90ed92f6a86731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.165294 5102 tablet_service.cc:1505] Processing CreateTablet for tablet 5f941295517b416faf90ed92f6a86731 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:09.166637 5102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f941295517b416faf90ed92f6a86731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.184926 4951 tablet_service.cc:1505] Processing CreateTablet for tablet 73bd702697d94bef938bc47293ef6145 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:09.188196 5026 tablet_service.cc:1505] Processing CreateTablet for tablet 73bd702697d94bef938bc47293ef6145 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:09.191787 5026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bd702697d94bef938bc47293ef6145. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.196056 4951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bd702697d94bef938bc47293ef6145. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.199743 5103 tablet_service.cc:1505] Processing CreateTablet for tablet 73bd702697d94bef938bc47293ef6145 (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:09.205765 5103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bd702697d94bef938bc47293ef6145. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.213191 5022 tablet_service.cc:1505] Processing CreateTablet for tablet 30078c1b709e48f683bf789b6b713cbd (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:09.214484 5022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30078c1b709e48f683bf789b6b713cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.216974 4954 tablet_service.cc:1505] Processing CreateTablet for tablet 30078c1b709e48f683bf789b6b713cbd (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:09.218348 4954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30078c1b709e48f683bf789b6b713cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.219820 5097 tablet_service.cc:1505] Processing CreateTablet for tablet 30078c1b709e48f683bf789b6b713cbd (DEFAULT_TABLE table=soft_deleted_table [id=1b26593c762741f1a9f668267868c68d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:09.221102 5097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30078c1b709e48f683bf789b6b713cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:09.225314 5254 tablet_bootstrap.cc:492] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.230890 5254 tablet_bootstrap.cc:654] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.251472 5255 tablet_bootstrap.cc:492] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.267107 5255 tablet_bootstrap.cc:654] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.268436 5253 tablet_bootstrap.cc:492] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.274298 5255 tablet_bootstrap.cc:492] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.274766 5253 tablet_bootstrap.cc:654] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.274782 5254 tablet_bootstrap.cc:492] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.274809 5255 ts_tablet_manager.cc:1403] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.004s
I20251215 20:54:09.275630 5254 ts_tablet_manager.cc:1403] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.000s
I20251215 20:54:09.278002 5255 raft_consensus.cc:359] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.278218 5254 raft_consensus.cc:359] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.278753 5255 raft_consensus.cc:385] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.278900 5254 raft_consensus.cc:385] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.279105 5255 raft_consensus.cc:740] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.279181 5253 tablet_bootstrap.cc:492] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.279217 5254 raft_consensus.cc:740] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.279906 5255 consensus_queue.cc:260] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.280228 5254 consensus_queue.cc:260] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.282266 5255 ts_tablet_manager.cc:1434] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:54:09.283241 5255 tablet_bootstrap.cc:492] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.280753 5253 ts_tablet_manager.cc:1403] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20251215 20:54:09.286341 5253 raft_consensus.cc:359] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.287063 5253 raft_consensus.cc:385] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.287387 5253 raft_consensus.cc:740] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.288115 5253 consensus_queue.cc:260] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.289747 5253 ts_tablet_manager.cc:1434] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:54:09.290632 5253 tablet_bootstrap.cc:492] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.290694 5255 tablet_bootstrap.cc:654] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.296592 5253 tablet_bootstrap.cc:654] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.298070 5254 ts_tablet_manager.cc:1434] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.022s user 0.003s sys 0.004s
I20251215 20:54:09.300570 5254 tablet_bootstrap.cc:492] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.300999 5253 tablet_bootstrap.cc:492] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.301375 5253 ts_tablet_manager.cc:1403] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20251215 20:54:09.303689 5253 raft_consensus.cc:359] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.304185 5253 raft_consensus.cc:385] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.304888 5253 raft_consensus.cc:740] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.305632 5253 consensus_queue.cc:260] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.306142 5254 tablet_bootstrap.cc:654] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.306232 5255 tablet_bootstrap.cc:492] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.306834 5255 ts_tablet_manager.cc:1403] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.004s
I20251215 20:54:09.308328 5253 ts_tablet_manager.cc:1434] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251215 20:54:09.309266 5253 tablet_bootstrap.cc:492] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.309710 5255 raft_consensus.cc:359] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.310447 5255 raft_consensus.cc:385] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.310756 5255 raft_consensus.cc:740] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.311446 5255 consensus_queue.cc:260] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.313838 5255 ts_tablet_manager.cc:1434] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20251215 20:54:09.314788 5255 tablet_bootstrap.cc:492] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.315642 5253 tablet_bootstrap.cc:654] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
W20251215 20:54:09.319722 5066 tablet.cc:2378] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 20:54:09.324710 5255 tablet_bootstrap.cc:654] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.315631 5161 raft_consensus.cc:493] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.326328 5161 raft_consensus.cc:515] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.326932 5253 tablet_bootstrap.cc:492] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.327492 5253 ts_tablet_manager.cc:1403] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.011s
I20251215 20:54:09.329427 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed719c77ae6b42f98c1e11fdfaa4a86d" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
W20251215 20:54:09.330960 4930 leader_election.cc:343] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:09.331431 5186 raft_consensus.cc:493] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.331930 5186 raft_consensus.cc:515] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.332741 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed719c77ae6b42f98c1e11fdfaa4a86d" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.333400 5040 raft_consensus.cc:2468] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 0.
I20251215 20:54:09.333855 5186 leader_election.cc:290] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.334656 4931 leader_election.cc:304] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters: 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:09.335521 5242 raft_consensus.cc:2804] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.335736 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed719c77ae6b42f98c1e11fdfaa4a86d" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.336015 5242 raft_consensus.cc:493] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.336414 5242 raft_consensus.cc:3060] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.337339 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed719c77ae6b42f98c1e11fdfaa4a86d" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
W20251215 20:54:09.338655 5005 leader_election.cc:343] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:09.330287 5253 raft_consensus.cc:359] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.339481 5253 raft_consensus.cc:385] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.339833 5253 raft_consensus.cc:740] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.340574 5161 leader_election.cc:290] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.340613 5253 consensus_queue.cc:260] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.342739 5255 tablet_bootstrap.cc:492] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.343127 5255 ts_tablet_manager.cc:1403] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.029s user 0.015s sys 0.007s
I20251215 20:54:09.343946 5253 ts_tablet_manager.cc:1434] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20251215 20:54:09.345048 5253 tablet_bootstrap.cc:492] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.345441 5255 raft_consensus.cc:359] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.346140 5255 raft_consensus.cc:385] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.346446 5255 raft_consensus.cc:740] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.347139 5255 consensus_queue.cc:260] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.349086 5242 raft_consensus.cc:515] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.363200 4964 raft_consensus.cc:2393] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7adbc795f55441b6bccad811ca6f95c6 in current term 1: Already voted for candidate c1d56ae93a9e42e0b257f491deb526ae in this term.
I20251215 20:54:09.365314 5253 tablet_bootstrap.cc:654] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.366212 5006 leader_election.cc:304] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6; no voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:09.367444 5186 raft_consensus.cc:3060] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.374759 5186 raft_consensus.cc:2749] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:09.381244 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed719c77ae6b42f98c1e11fdfaa4a86d" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
W20251215 20:54:09.382652 4930 leader_election.cc:343] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:09.383248 5242 leader_election.cc:290] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.390736 5254 tablet_bootstrap.cc:492] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.390995 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed719c77ae6b42f98c1e11fdfaa4a86d" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:09.391310 5254 ts_tablet_manager.cc:1403] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.091s user 0.033s sys 0.056s
I20251215 20:54:09.391741 5255 ts_tablet_manager.cc:1434] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.048s user 0.012s sys 0.036s
I20251215 20:54:09.392763 5255 tablet_bootstrap.cc:492] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.394073 5254 raft_consensus.cc:359] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.394752 5254 raft_consensus.cc:385] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.395022 5254 raft_consensus.cc:740] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.395942 5040 raft_consensus.cc:2468] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 1.
I20251215 20:54:09.395726 5254 consensus_queue.cc:260] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.398388 4931 leader_election.cc:304] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters: 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:09.398833 5255 tablet_bootstrap.cc:654] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.399102 5264 raft_consensus.cc:2804] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.399842 5264 raft_consensus.cc:697] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:09.400701 5264 consensus_queue.cc:237] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.402527 5254 ts_tablet_manager.cc:1434] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20251215 20:54:09.403335 5254 tablet_bootstrap.cc:492] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.405627 5253 tablet_bootstrap.cc:492] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.406282 5253 ts_tablet_manager.cc:1403] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.061s user 0.010s sys 0.002s
I20251215 20:54:09.411989 5254 tablet_bootstrap.cc:654] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.414057 5253 raft_consensus.cc:359] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.414815 5253 raft_consensus.cc:385] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.415115 5253 raft_consensus.cc:740] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.415798 5253 consensus_queue.cc:260] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.418111 5253 ts_tablet_manager.cc:1434] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.011s user 0.001s sys 0.004s
I20251215 20:54:09.421273 5253 tablet_bootstrap.cc:492] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.423976 4862 catalog_manager.cc:5654] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 0 to 1, leader changed from <none> to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 1 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:09.427374 5253 tablet_bootstrap.cc:654] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.434087 5255 tablet_bootstrap.cc:492] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.434527 5255 ts_tablet_manager.cc:1403] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.042s user 0.013s sys 0.016s
I20251215 20:54:09.436434 5254 tablet_bootstrap.cc:492] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.437086 5254 ts_tablet_manager.cc:1403] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.011s
I20251215 20:54:09.437049 5255 raft_consensus.cc:359] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.438424 5255 raft_consensus.cc:385] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.438680 5255 raft_consensus.cc:740] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.439332 5253 tablet_bootstrap.cc:492] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.439265 5255 consensus_queue.cc:260] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.439795 5253 ts_tablet_manager.cc:1403] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.006s
I20251215 20:54:09.439824 5254 raft_consensus.cc:359] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.440974 5254 raft_consensus.cc:385] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.441269 5254 raft_consensus.cc:740] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.441606 5255 ts_tablet_manager.cc:1434] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
I20251215 20:54:09.442044 5254 consensus_queue.cc:260] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.442587 5255 tablet_bootstrap.cc:492] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.442639 5253 raft_consensus.cc:359] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.443542 5253 raft_consensus.cc:385] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.443871 5253 raft_consensus.cc:740] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.444618 5254 ts_tablet_manager.cc:1434] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20251215 20:54:09.444728 5253 consensus_queue.cc:260] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.445649 5254 tablet_bootstrap.cc:492] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.449208 5255 tablet_bootstrap.cc:654] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.449729 5253 ts_tablet_manager.cc:1434] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20251215 20:54:09.450764 5253 tablet_bootstrap.cc:492] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.451870 5254 tablet_bootstrap.cc:654] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.456653 5253 tablet_bootstrap.cc:654] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.460438 5255 tablet_bootstrap.cc:492] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.460896 5255 ts_tablet_manager.cc:1403] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.006s
I20251215 20:54:09.463181 5254 tablet_bootstrap.cc:492] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.463788 5254 ts_tablet_manager.cc:1403] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20251215 20:54:09.463450 5255 raft_consensus.cc:359] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.464388 5255 raft_consensus.cc:385] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.464735 5255 raft_consensus.cc:740] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.465443 5255 consensus_queue.cc:260] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.466933 5254 raft_consensus.cc:359] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.467691 5254 raft_consensus.cc:385] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.467826 5255 ts_tablet_manager.cc:1434] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
I20251215 20:54:09.468042 5254 raft_consensus.cc:740] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.468238 5253 tablet_bootstrap.cc:492] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.468842 5253 ts_tablet_manager.cc:1403] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20251215 20:54:09.468910 5255 tablet_bootstrap.cc:492] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.468992 5254 consensus_queue.cc:260] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.471627 5254 ts_tablet_manager.cc:1434] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20251215 20:54:09.471575 5253 raft_consensus.cc:359] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.472424 5253 raft_consensus.cc:385] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.472741 5254 tablet_bootstrap.cc:492] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.472756 5253 raft_consensus.cc:740] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.473781 5253 consensus_queue.cc:260] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.475354 5255 tablet_bootstrap.cc:654] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.476452 5203 raft_consensus.cc:493] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.476912 5203 raft_consensus.cc:515] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.478557 5253 ts_tablet_manager.cc:1434] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20251215 20:54:09.478771 5203 leader_election.cc:290] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:09.479318 5254 tablet_bootstrap.cc:654] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.479475 5253 tablet_bootstrap.cc:492] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.481091 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "778311f17c024c54800fdcd286efffbc" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.481554 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "778311f17c024c54800fdcd286efffbc" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.481747 4964 raft_consensus.cc:2468] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:09.482152 5040 raft_consensus.cc:2468] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:09.485491 5080 leader_election.cc:304] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:09.485922 5253 tablet_bootstrap.cc:654] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.490669 5254 tablet_bootstrap.cc:492] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.491214 5254 ts_tablet_manager.cc:1403] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.004s
I20251215 20:54:09.494259 5254 raft_consensus.cc:359] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.495126 5254 raft_consensus.cc:385] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.495479 5254 raft_consensus.cc:740] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.496335 5186 raft_consensus.cc:493] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.496376 5254 consensus_queue.cc:260] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.497016 5186 raft_consensus.cc:515] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.499070 5186 leader_election.cc:290] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.500540 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
W20251215 20:54:09.502082 5006 leader_election.cc:343] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:09.500614 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:09.502841 5112 raft_consensus.cc:2468] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:09.503918 5005 leader_election.cc:304] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters: c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:09.505059 5186 raft_consensus.cc:2804] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.505097 5253 tablet_bootstrap.cc:492] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.505561 5186 raft_consensus.cc:493] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.505934 5186 raft_consensus.cc:3060] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.505982 5253 ts_tablet_manager.cc:1403] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.008s
I20251215 20:54:09.508903 5253 raft_consensus.cc:359] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.509392 5254 ts_tablet_manager.cc:1434] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.018s user 0.010s sys 0.005s
I20251215 20:54:09.509652 5253 raft_consensus.cc:385] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.509581 5267 raft_consensus.cc:493] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.510918 5267 raft_consensus.cc:515] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.511427 5254 tablet_bootstrap.cc:492] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.500429 5203 raft_consensus.cc:2804] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.512410 5203 raft_consensus.cc:493] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.512758 5203 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.512923 5267 leader_election.cc:290] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.514328 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f941295517b416faf90ed92f6a86731" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:09.514937 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f941295517b416faf90ed92f6a86731" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.514990 5186 raft_consensus.cc:515] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
W20251215 20:54:09.515592 5005 leader_election.cc:343] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:09.515714 4964 raft_consensus.cc:2468] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:09.516316 5253 raft_consensus.cc:740] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.517043 5253 consensus_queue.cc:260] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.518321 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:09.518842 5112 raft_consensus.cc:3060] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.519183 5254 tablet_bootstrap.cc:654] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.520473 5253 ts_tablet_manager.cc:1434] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20251215 20:54:09.521056 5006 leader_election.cc:304] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters: 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:09.521782 5267 raft_consensus.cc:2804] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.522183 5267 raft_consensus.cc:493] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.522508 5267 raft_consensus.cc:3060] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.524113 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:09.524932 5112 raft_consensus.cc:2468] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:09.525913 5005 leader_election.cc:304] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:09.521476 5253 tablet_bootstrap.cc:492] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.531566 5267 raft_consensus.cc:515] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
W20251215 20:54:09.539856 5006 leader_election.cc:343] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:09.539928 5281 raft_consensus.cc:2804] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.542273 5267 leader_election.cc:290] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.544708 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f941295517b416faf90ed92f6a86731" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:09.538048 5186 leader_election.cc:290] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.549860 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f941295517b416faf90ed92f6a86731" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:09.552181 4964 raft_consensus.cc:3060] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.553898 5254 tablet_bootstrap.cc:492] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.553584 5203 raft_consensus.cc:515] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.554396 5254 ts_tablet_manager.cc:1403] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.016s
I20251215 20:54:09.557072 5254 raft_consensus.cc:359] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.557809 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "778311f17c024c54800fdcd286efffbc" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:09.558393 5040 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.558795 4964 raft_consensus.cc:2468] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
W20251215 20:54:09.550004 5005 leader_election.cc:343] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:09.557703 5254 raft_consensus.cc:385] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.560170 5255 tablet_bootstrap.cc:492] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.560472 5254 raft_consensus.cc:740] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.560781 5255 ts_tablet_manager.cc:1403] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.092s user 0.022s sys 0.027s
I20251215 20:54:09.560791 5253 tablet_bootstrap.cc:654] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.561340 5254 consensus_queue.cc:260] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.563544 5255 raft_consensus.cc:359] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.564213 5255 raft_consensus.cc:385] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.564524 5255 raft_consensus.cc:740] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.565156 5255 consensus_queue.cc:260] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.565568 5006 leader_election.cc:304] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters: 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:09.566744 5186 raft_consensus.cc:2804] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.567240 5186 raft_consensus.cc:697] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:09.567453 5255 ts_tablet_manager.cc:1434] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 20:54:09.568395 5255 tablet_bootstrap.cc:492] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.568009 5186 consensus_queue.cc:237] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.572901 5203 leader_election.cc:290] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:09.574710 5255 tablet_bootstrap.cc:654] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.577543 5254 ts_tablet_manager.cc:1434] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.023s user 0.005s sys 0.003s
W20251215 20:54:09.579262 4910 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:54:09.585988 5254 tablet_bootstrap.cc:492] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.593169 5040 raft_consensus.cc:2468] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 1.
I20251215 20:54:09.594130 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "778311f17c024c54800fdcd286efffbc" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:09.595466 5080 leader_election.cc:304] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:09.595820 4964 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.596532 5203 raft_consensus.cc:2804] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.597685 5264 raft_consensus.cc:493] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.598412 5264 raft_consensus.cc:515] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.599081 5281 raft_consensus.cc:697] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:09.600200 5281 consensus_queue.cc:237] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.601971 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:09.602546 5264 leader_election.cc:290] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.603111 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.603142 4860 catalog_manager.cc:5654] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
W20251215 20:54:09.604709 4931 leader_election.cc:343] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:54:09.605230 4930 leader_election.cc:343] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:09.605683 4930 leader_election.cc:304] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1d56ae93a9e42e0b257f491deb526ae; no voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6
I20251215 20:54:09.606856 5264 raft_consensus.cc:2749] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:09.597653 5203 raft_consensus.cc:697] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:09.608870 5203 consensus_queue.cc:237] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.608117 5254 tablet_bootstrap.cc:654] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.613595 5186 raft_consensus.cc:493] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.614068 5186 raft_consensus.cc:515] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.616458 5278 raft_consensus.cc:493] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.616919 5278 raft_consensus.cc:515] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.617393 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c9900d3933a4ba79c7753485e3754d4" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:09.617659 5255 tablet_bootstrap.cc:492] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.618431 4964 raft_consensus.cc:2468] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 1.
I20251215 20:54:09.616096 5186 leader_election.cc:290] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.619391 5112 raft_consensus.cc:2468] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:09.620574 5278 leader_election.cc:290] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:09.621654 5005 leader_election.cc:304] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:09.622212 5253 tablet_bootstrap.cc:492] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.622490 5186 raft_consensus.cc:2804] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.622728 5253 ts_tablet_manager.cc:1403] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.101s user 0.018s sys 0.026s
I20251215 20:54:09.622895 5186 raft_consensus.cc:493] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.623278 5186 raft_consensus.cc:3060] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.618718 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c9900d3933a4ba79c7753485e3754d4" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.624044 4965 raft_consensus.cc:2468] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:09.625834 5253 raft_consensus.cc:359] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.626573 5253 raft_consensus.cc:385] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.626950 5253 raft_consensus.cc:740] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.627571 5253 consensus_queue.cc:260] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.627878 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c9900d3933a4ba79c7753485e3754d4" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.629256 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c9900d3933a4ba79c7753485e3754d4" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.629755 5253 ts_tablet_manager.cc:1434] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:54:09.629925 4964 raft_consensus.cc:2468] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:09.630193 5186 raft_consensus.cc:515] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.631312 5040 raft_consensus.cc:2393] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 112ac20bd86a4be9a90456833a5c664d in current term 1: Already voted for candidate 7adbc795f55441b6bccad811ca6f95c6 in this term.
I20251215 20:54:09.631263 5080 leader_election.cc:304] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:09.618450 5255 ts_tablet_manager.cc:1403] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.050s user 0.014s sys 0.030s
I20251215 20:54:09.632366 5278 raft_consensus.cc:2804] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.632773 5278 raft_consensus.cc:493] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.633176 5278 raft_consensus.cc:3060] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.634567 5255 raft_consensus.cc:359] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.635306 5255 raft_consensus.cc:385] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.635316 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c9900d3933a4ba79c7753485e3754d4" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:09.635668 5255 raft_consensus.cc:740] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.636000 4965 raft_consensus.cc:3060] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.636651 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c9900d3933a4ba79c7753485e3754d4" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:09.637665 5186 leader_election.cc:290] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.639149 5253 tablet_bootstrap.cc:492] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6: Bootstrap starting.
I20251215 20:54:09.647682 5255 consensus_queue.cc:260] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.648759 4965 raft_consensus.cc:2468] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:09.650445 5006 leader_election.cc:304] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:09.651628 5280 raft_consensus.cc:2804] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.652133 5280 raft_consensus.cc:697] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:09.653038 5280 consensus_queue.cc:237] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.657339 5255 ts_tablet_manager.cc:1434] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.025s user 0.001s sys 0.005s
I20251215 20:54:09.657243 4860 catalog_manager.cc:5654] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:09.659543 5253 tablet_bootstrap.cc:654] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.660871 5255 tablet_bootstrap.cc:492] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.671447 5278 raft_consensus.cc:515] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.672756 5255 tablet_bootstrap.cc:654] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.674659 5112 raft_consensus.cc:2393] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7adbc795f55441b6bccad811ca6f95c6 in current term 1: Already voted for candidate 112ac20bd86a4be9a90456833a5c664d in this term.
I20251215 20:54:09.674542 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c9900d3933a4ba79c7753485e3754d4" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:09.675495 4965 raft_consensus.cc:2393] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 112ac20bd86a4be9a90456833a5c664d in current term 1: Already voted for candidate 7adbc795f55441b6bccad811ca6f95c6 in this term.
I20251215 20:54:09.678057 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8c9900d3933a4ba79c7753485e3754d4" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:09.683101 4863 catalog_manager.cc:5654] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:09.689270 5253 tablet_bootstrap.cc:492] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6: No bootstrap required, opened a new log
I20251215 20:54:09.689800 5253 ts_tablet_manager.cc:1403] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6: Time spent bootstrapping tablet: real 0.051s user 0.015s sys 0.012s
I20251215 20:54:09.689742 5292 raft_consensus.cc:493] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.690316 5292 raft_consensus.cc:515] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.691236 5278 leader_election.cc:290] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:09.692654 5253 raft_consensus.cc:359] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.693311 5253 raft_consensus.cc:385] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.693581 5253 raft_consensus.cc:740] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.694121 5253 consensus_queue.cc:260] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.696141 5253 ts_tablet_manager.cc:1434] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20251215 20:54:09.692122 5292 leader_election.cc:290] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:09.698951 5255 tablet_bootstrap.cc:492] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.699554 5255 ts_tablet_manager.cc:1403] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.003s
I20251215 20:54:09.702247 5255 raft_consensus.cc:359] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.702857 5255 raft_consensus.cc:385] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.703125 5255 raft_consensus.cc:740] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.703694 5255 consensus_queue.cc:260] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.706197 5254 tablet_bootstrap.cc:492] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.706600 5254 ts_tablet_manager.cc:1403] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.121s user 0.027s sys 0.034s
I20251215 20:54:09.708635 5254 raft_consensus.cc:359] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.709277 5254 raft_consensus.cc:385] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.709546 5254 raft_consensus.cc:740] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.710016 5254 consensus_queue.cc:260] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.711916 5254 ts_tablet_manager.cc:1434] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20251215 20:54:09.712671 5254 tablet_bootstrap.cc:492] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.713402 5264 raft_consensus.cc:493] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.713874 5264 raft_consensus.cc:515] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.714457 5255 ts_tablet_manager.cc:1434] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20251215 20:54:09.715804 5080 leader_election.cc:304] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d; no voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:09.716934 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:09.717600 5112 raft_consensus.cc:2393] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1d56ae93a9e42e0b257f491deb526ae in current term 1: Already voted for candidate 7adbc795f55441b6bccad811ca6f95c6 in this term.
I20251215 20:54:09.715714 5264 leader_election.cc:290] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.719127 5254 tablet_bootstrap.cc:654] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.717927 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.721572 5290 raft_consensus.cc:2749] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:54:09.722561 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed719c77ae6b42f98c1e11fdfaa4a86d" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.723346 5040 raft_consensus.cc:2393] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 112ac20bd86a4be9a90456833a5c664d in current term 1: Already voted for candidate c1d56ae93a9e42e0b257f491deb526ae in this term.
I20251215 20:54:09.724985 4930 leader_election.cc:304] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1d56ae93a9e42e0b257f491deb526ae; no voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6
I20251215 20:54:09.725528 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed719c77ae6b42f98c1e11fdfaa4a86d" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.726178 5264 raft_consensus.cc:3060] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.726440 5254 tablet_bootstrap.cc:492] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.726840 5254 ts_tablet_manager.cc:1403] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20251215 20:54:09.726990 5080 leader_election.cc:304] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d; no voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:09.727902 5290 raft_consensus.cc:3060] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.731611 5255 tablet_bootstrap.cc:492] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae: Bootstrap starting.
I20251215 20:54:09.734270 5264 raft_consensus.cc:2749] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:09.734787 5290 raft_consensus.cc:2749] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:09.736783 5254 raft_consensus.cc:359] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.737432 5254 raft_consensus.cc:385] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.737681 5254 raft_consensus.cc:740] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.738247 5254 consensus_queue.cc:260] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.740211 5254 ts_tablet_manager.cc:1434] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20251215 20:54:09.741024 5254 tablet_bootstrap.cc:492] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d: Bootstrap starting.
I20251215 20:54:09.741101 4863 catalog_manager.cc:5654] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 0 to 1, leader changed from <none> to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 1 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:09.742340 5255 tablet_bootstrap.cc:654] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.745934 5254 tablet_bootstrap.cc:654] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:09.749645 5255 tablet_bootstrap.cc:492] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae: No bootstrap required, opened a new log
I20251215 20:54:09.750303 5255 ts_tablet_manager.cc:1403] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.003s
I20251215 20:54:09.752676 5255 raft_consensus.cc:359] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.753290 5255 raft_consensus.cc:385] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.753546 5255 raft_consensus.cc:740] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.754148 5255 consensus_queue.cc:260] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.755703 5255 ts_tablet_manager.cc:1434] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 20:54:09.756644 5254 tablet_bootstrap.cc:492] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d: No bootstrap required, opened a new log
I20251215 20:54:09.757071 5254 ts_tablet_manager.cc:1403] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.009s
I20251215 20:54:09.759323 5254 raft_consensus.cc:359] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.759892 5254 raft_consensus.cc:385] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:09.760166 5254 raft_consensus.cc:740] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Initialized, Role: FOLLOWER
I20251215 20:54:09.760990 5280 raft_consensus.cc:493] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.761444 5280 raft_consensus.cc:515] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.763355 5280 leader_election.cc:290] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.760749 5254 consensus_queue.cc:260] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.763690 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73bd702697d94bef938bc47293ef6145" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.763978 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73bd702697d94bef938bc47293ef6145" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:09.764355 4965 raft_consensus.cc:2468] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:09.764686 5112 raft_consensus.cc:2468] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:09.765563 5006 leader_election.cc:304] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:09.766534 5280 raft_consensus.cc:2804] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.766871 5280 raft_consensus.cc:493] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.767196 5280 raft_consensus.cc:3060] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.767710 5254 ts_tablet_manager.cc:1434] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20251215 20:54:09.774251 5280 raft_consensus.cc:515] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.775823 5280 leader_election.cc:290] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.776427 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73bd702697d94bef938bc47293ef6145" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:09.776940 4965 raft_consensus.cc:3060] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.776849 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73bd702697d94bef938bc47293ef6145" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:09.777503 5112 raft_consensus.cc:3060] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.779356 5280 raft_consensus.cc:493] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.779878 5280 raft_consensus.cc:515] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.781728 5112 raft_consensus.cc:2468] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:09.782598 4964 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4fa4ed1647f4a28ac1de074ee2e7b5e" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.782827 5005 leader_election.cc:304] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:09.783250 4964 raft_consensus.cc:2468] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:09.783803 5186 raft_consensus.cc:2804] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.783871 5280 leader_election.cc:290] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.784463 5186 raft_consensus.cc:697] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:09.784677 5006 leader_election.cc:304] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:09.783519 4965 raft_consensus.cc:2468] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:09.785437 5281 raft_consensus.cc:2804] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.785171 5186 consensus_queue.cc:237] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.785691 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4fa4ed1647f4a28ac1de074ee2e7b5e" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:09.785854 5281 raft_consensus.cc:493] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.786259 5281 raft_consensus.cc:3060] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.786935 5112 raft_consensus.cc:2468] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 0.
I20251215 20:54:09.792177 5281 raft_consensus.cc:515] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.794072 5281 leader_election.cc:290] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.794356 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4fa4ed1647f4a28ac1de074ee2e7b5e" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:09.794566 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4fa4ed1647f4a28ac1de074ee2e7b5e" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:09.795022 5112 raft_consensus.cc:3060] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.795403 4965 raft_consensus.cc:3060] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.800767 5112 raft_consensus.cc:2468] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:09.801744 5005 leader_election.cc:304] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:09.801812 4965 raft_consensus.cc:2468] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 1.
I20251215 20:54:09.802568 5281 raft_consensus.cc:2804] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.803032 5281 raft_consensus.cc:697] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:09.803789 5281 consensus_queue.cc:237] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.804212 4863 catalog_manager.cc:5654] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:09.818372 4863 catalog_manager.cc:5654] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:09.824086 5264 raft_consensus.cc:493] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.824611 5264 raft_consensus.cc:515] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.826057 5264 leader_election.cc:290] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.826839 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30078c1b709e48f683bf789b6b713cbd" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.826995 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30078c1b709e48f683bf789b6b713cbd" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d" is_pre_election: true
I20251215 20:54:09.827442 5040 raft_consensus.cc:2468] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 0.
I20251215 20:54:09.827586 5112 raft_consensus.cc:2468] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 0.
I20251215 20:54:09.828528 4931 leader_election.cc:304] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:09.829169 5264 raft_consensus.cc:2804] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.829484 5264 raft_consensus.cc:493] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.829700 5264 raft_consensus.cc:3060] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.833987 5264 raft_consensus.cc:515] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.835320 5264 leader_election.cc:290] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:09.835986 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30078c1b709e48f683bf789b6b713cbd" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:09.836351 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30078c1b709e48f683bf789b6b713cbd" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:09.836570 5040 raft_consensus.cc:3060] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.836854 5112 raft_consensus.cc:3060] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.842720 5112 raft_consensus.cc:2468] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 1.
I20251215 20:54:09.842864 5040 raft_consensus.cc:2468] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 1.
I20251215 20:54:09.843604 4930 leader_election.cc:304] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:09.844244 5264 raft_consensus.cc:2804] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.844692 5264 raft_consensus.cc:697] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:09.845335 5264 consensus_queue.cc:237] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.852257 4863 catalog_manager.cc:5654] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 0 to 1, leader changed from <none> to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 1 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:09.907685 5264 consensus_queue.cc:1048] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:09.924671 5161 consensus_queue.cc:1048] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:09.948328 5290 raft_consensus.cc:493] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.948704 5290 raft_consensus.cc:515] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.950209 5290 leader_election.cc:290] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:09.950857 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.951090 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.951534 4965 raft_consensus.cc:2468] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:09.951673 5040 raft_consensus.cc:2468] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 0.
I20251215 20:54:09.952477 5080 leader_election.cc:304] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:09.953037 5290 raft_consensus.cc:2804] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:09.953290 5290 raft_consensus.cc:493] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:09.953534 5290 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.957835 5290 raft_consensus.cc:515] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.959122 5290 leader_election.cc:290] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:09.959784 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:09.960001 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:09.960260 4965 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.960561 5040 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.964577 4965 raft_consensus.cc:2468] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 1.
I20251215 20:54:09.964623 5290 raft_consensus.cc:493] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:09.964735 5040 raft_consensus.cc:2468] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 1.
I20251215 20:54:09.965562 5080 leader_election.cc:304] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:09.965391 5290 raft_consensus.cc:515] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.966199 5203 raft_consensus.cc:2804] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:09.966665 5203 raft_consensus.cc:697] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:09.967273 5290 leader_election.cc:290] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:09.967451 5203 consensus_queue.cc:237] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:09.967964 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f941295517b416faf90ed92f6a86731" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae" is_pre_election: true
I20251215 20:54:09.968098 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f941295517b416faf90ed92f6a86731" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adbc795f55441b6bccad811ca6f95c6" is_pre_election: true
I20251215 20:54:09.968662 4965 raft_consensus.cc:2393] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 112ac20bd86a4be9a90456833a5c664d in current term 1: Already voted for candidate 7adbc795f55441b6bccad811ca6f95c6 in this term.
I20251215 20:54:09.969501 5080 leader_election.cc:304] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d; no voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:09.970089 5290 raft_consensus.cc:3060] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:09.975557 5290 raft_consensus.cc:2749] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:09.975497 4860 catalog_manager.cc:5654] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 0 to 1, leader changed from <none> to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 1 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:09.990674 5281 consensus_queue.cc:1048] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:09.999336 5186 consensus_queue.cc:1048] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.005280 5290 consensus_queue.cc:1048] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.018461 5203 consensus_queue.cc:1048] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.025663 5039 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
mode: GRACEFUL
new_leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:36960
I20251215 20:54:10.026221 5039 raft_consensus.cc:606] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Received request to transfer leadership to TS c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:10.030850 5112 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
mode: GRACEFUL
new_leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:46868
I20251215 20:54:10.031242 5112 raft_consensus.cc:606] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Received request to transfer leadership to TS c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:10.035717 5039 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b4fa4ed1647f4a28ac1de074ee2e7b5e"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
mode: GRACEFUL
new_leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:36960
I20251215 20:54:10.036128 5039 raft_consensus.cc:606] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Received request to transfer leadership to TS c1d56ae93a9e42e0b257f491deb526ae
I20251215 20:54:10.042330 5112 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "778311f17c024c54800fdcd286efffbc"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
mode: GRACEFUL
new_leader_uuid: "7adbc795f55441b6bccad811ca6f95c6"
from {username='slave'} at 127.0.0.1:46868
I20251215 20:54:10.042716 5112 raft_consensus.cc:606] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Received request to transfer leadership to TS 7adbc795f55441b6bccad811ca6f95c6
I20251215 20:54:10.050422 4965 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "30078c1b709e48f683bf789b6b713cbd"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
mode: GRACEFUL
new_leader_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:53214
I20251215 20:54:10.050810 4965 raft_consensus.cc:606] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Received request to transfer leadership to TS 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:10.166463 5186 consensus_queue.cc:1048] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.181495 5186 consensus_queue.cc:1048] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.203267 5186 consensus_queue.cc:1048] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.207906 5186 consensus_queue.cc:1048] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.215023 5267 consensus_queue.cc:1048] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.221896 5186 consensus_queue.cc:1048] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.232959 5281 raft_consensus.cc:993] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6: : Instructing follower c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:10.233362 5281 raft_consensus.cc:1081] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Signalling peer c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:10.235047 4965 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:53212
I20251215 20:54:10.235524 4965 raft_consensus.cc:493] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:10.235839 4965 raft_consensus.cc:3060] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.241864 4965 raft_consensus.cc:515] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.243629 4965 leader_election.cc:290] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:10.243788 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:10.244113 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a95f03f628c6421ba58a7ae937e1c539" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:10.244539 5039 raft_consensus.cc:3055] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:10.244688 5112 raft_consensus.cc:3060] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.244881 5039 raft_consensus.cc:740] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:10.245661 5039 consensus_queue.cc:260] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.246882 5039 raft_consensus.cc:3060] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.250723 5112 raft_consensus.cc:2468] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:10.251634 4930 leader_election.cc:304] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:10.252234 5161 raft_consensus.cc:2804] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:10.252699 5161 raft_consensus.cc:697] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:10.253023 5039 raft_consensus.cc:2468] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:10.253465 5161 consensus_queue.cc:237] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.259598 4861 catalog_manager.cc:5654] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 1 to 2, leader changed from 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130) to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 2 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:10.282594 5161 consensus_queue.cc:1048] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.292502 5267 consensus_queue.cc:1048] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.293960 5161 consensus_queue.cc:1048] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:54:10.299726 5267 raft_consensus.cc:993] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6: : Instructing follower c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:10.300127 5267 raft_consensus.cc:1081] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Signalling peer c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:10.303742 4964 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b4fa4ed1647f4a28ac1de074ee2e7b5e"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:53212
I20251215 20:54:10.304184 4964 raft_consensus.cc:493] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:10.304495 4964 raft_consensus.cc:3060] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.306730 5281 consensus_queue.cc:1048] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.307598 5301 raft_consensus.cc:993] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae: : Instructing follower 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:10.308033 5301 raft_consensus.cc:1081] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Signalling peer 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:10.309480 5113 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "30078c1b709e48f683bf789b6b713cbd"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:46854
I20251215 20:54:10.309971 5113 raft_consensus.cc:493] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:10.310307 5113 raft_consensus.cc:3060] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.314924 5113 raft_consensus.cc:515] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.315547 4964 raft_consensus.cc:515] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.316562 4965 raft_consensus.cc:1240] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Rejecting Update request from peer 7adbc795f55441b6bccad811ca6f95c6 for earlier term 1. Current term is 2. Ops: []
I20251215 20:54:10.317389 4964 leader_election.cc:290] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:10.318073 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4fa4ed1647f4a28ac1de074ee2e7b5e" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:10.318596 5040 raft_consensus.cc:3055] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:10.318773 5114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4fa4ed1647f4a28ac1de074ee2e7b5e" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:10.317584 4963 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30078c1b709e48f683bf789b6b713cbd" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:10.319317 5040 raft_consensus.cc:740] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:10.319432 4963 raft_consensus.cc:3055] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:10.319792 4963 raft_consensus.cc:740] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:10.320005 5040 consensus_queue.cc:260] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.320771 5040 raft_consensus.cc:3060] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.320502 4963 consensus_queue.cc:260] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.321642 4963 raft_consensus.cc:3060] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.323088 5113 leader_election.cc:290] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 2 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:10.324026 5039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30078c1b709e48f683bf789b6b713cbd" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:10.324607 5039 raft_consensus.cc:3060] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.326941 5040 raft_consensus.cc:2468] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:10.328045 4931 leader_election.cc:304] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters: 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:10.328881 4963 raft_consensus.cc:2468] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 2.
I20251215 20:54:10.329125 5161 raft_consensus.cc:2804] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:10.329646 5161 raft_consensus.cc:697] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:10.330111 5080 leader_election.cc:304] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:10.330404 5161 consensus_queue.cc:237] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.331137 5039 raft_consensus.cc:2468] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 2.
I20251215 20:54:10.331737 5292 raft_consensus.cc:2804] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:10.332240 5292 raft_consensus.cc:697] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 2 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:10.334915 5292 consensus_queue.cc:237] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.338071 4863 catalog_manager.cc:5654] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 1 to 2, leader changed from 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130) to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 2 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:10.341343 4861 catalog_manager.cc:5654] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 1 to 2, leader changed from c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129) to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 2 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:10.436149 5203 raft_consensus.cc:993] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d: : Instructing follower 7adbc795f55441b6bccad811ca6f95c6 to start an election
I20251215 20:54:10.436655 5203 raft_consensus.cc:1081] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Signalling peer 7adbc795f55441b6bccad811ca6f95c6 to start an election
I20251215 20:54:10.438012 5039 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "778311f17c024c54800fdcd286efffbc"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
from {username='slave'} at 127.0.0.1:36936
I20251215 20:54:10.438557 5039 raft_consensus.cc:493] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:10.438995 5039 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.444630 5039 raft_consensus.cc:515] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.445986 5039 leader_election.cc:290] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 2 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:10.446556 4965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "778311f17c024c54800fdcd286efffbc" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:10.447121 4965 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.447008 5113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "778311f17c024c54800fdcd286efffbc" candidate_uuid: "7adbc795f55441b6bccad811ca6f95c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:10.447688 5113 raft_consensus.cc:3055] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:10.447997 5113 raft_consensus.cc:740] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:10.448738 5113 consensus_queue.cc:260] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.449877 5113 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.453197 4965 raft_consensus.cc:2468] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 2.
I20251215 20:54:10.454257 5006 leader_election.cc:304] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:10.455035 5267 raft_consensus.cc:2804] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:10.455487 5267 raft_consensus.cc:697] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:10.456194 5113 raft_consensus.cc:2468] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adbc795f55441b6bccad811ca6f95c6 in term 2.
I20251215 20:54:10.456248 5267 consensus_queue.cc:237] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.462747 4863 catalog_manager.cc:5654] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 reported cstate change: term changed from 1 to 2, leader changed from 112ac20bd86a4be9a90456833a5c664d (127.0.106.131) to 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7adbc795f55441b6bccad811ca6f95c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:10.578292 5203 consensus_queue.cc:1048] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.584228 5292 raft_consensus.cc:993] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d: : Instructing follower c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:10.584663 5292 raft_consensus.cc:1081] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Signalling peer c1d56ae93a9e42e0b257f491deb526ae to start an election
I20251215 20:54:10.587116 4963 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
from {username='slave'} at 127.0.0.1:53208
I20251215 20:54:10.587888 4963 raft_consensus.cc:493] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:10.588246 4963 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.588723 5290 consensus_queue.cc:1048] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:10.596764 4963 raft_consensus.cc:515] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.605085 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:10.605166 4963 leader_election.cc:290] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Requested vote from peers 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823), 112ac20bd86a4be9a90456833a5c664d (127.0.106.131:32819)
I20251215 20:54:10.605623 5040 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.609449 5112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "c1d56ae93a9e42e0b257f491deb526ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
I20251215 20:54:10.610067 5112 raft_consensus.cc:3055] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:10.610368 5112 raft_consensus.cc:740] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:10.611083 5112 consensus_queue.cc:260] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.612138 5112 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.619374 5040 raft_consensus.cc:2468] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:10.620280 4931 leader_election.cc:304] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adbc795f55441b6bccad811ca6f95c6, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:10.620908 5301 raft_consensus.cc:2804] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:10.621265 5301 raft_consensus.cc:697] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Leader. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:10.621999 5301 consensus_queue.cc:237] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:10.622609 5112 raft_consensus.cc:2468] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1d56ae93a9e42e0b257f491deb526ae in term 2.
I20251215 20:54:10.628053 4862 catalog_manager.cc:5654] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae reported cstate change: term changed from 1 to 2, leader changed from 112ac20bd86a4be9a90456833a5c664d (127.0.106.131) to c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129). New cstate: current_term: 2 leader_uuid: "c1d56ae93a9e42e0b257f491deb526ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:10.718570 5040 raft_consensus.cc:1275] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:10.719820 5301 consensus_queue.cc:1048] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:10.726541 5112 raft_consensus.cc:1275] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:10.727797 5264 consensus_queue.cc:1048] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:10.733758 5112 raft_consensus.cc:3060] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:10.741909 5112 raft_consensus.cc:1275] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:10.742962 5264 consensus_queue.cc:1048] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:10.749760 5040 raft_consensus.cc:1275] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:10.750932 5301 consensus_queue.cc:1048] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:10.796679 4963 raft_consensus.cc:1275] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:10.797839 5321 consensus_queue.cc:1048] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:10.804366 5040 raft_consensus.cc:1275] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:10.805702 5290 consensus_queue.cc:1048] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:10.865726 4965 raft_consensus.cc:1275] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Refusing update from remote peer 7adbc795f55441b6bccad811ca6f95c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:10.866936 5267 consensus_queue.cc:1048] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:10.873306 5112 raft_consensus.cc:1275] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer 7adbc795f55441b6bccad811ca6f95c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:10.874588 5281 consensus_queue.cc:1048] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:11.135299 5112 raft_consensus.cc:1275] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:11.136364 5301 consensus_queue.cc:1048] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:11.143353 5040 raft_consensus.cc:1275] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer c1d56ae93a9e42e0b257f491deb526ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:11.144557 5301 consensus_queue.cc:1048] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:13.053268 4862 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20251215 20:54:13.071034 4862 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20251215 20:54:13.102806 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:13.215173 5361 tablet.cc:1722] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.218700 5373 tablet.cc:1722] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.244266 5369 tablet.cc:1722] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.261947 4960 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
mode: GRACEFUL
new_leader_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:34138
I20251215 20:54:13.273526 5373 tablet.cc:1722] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.290202 5363 tablet.cc:1722] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.303525 5381 tablet.cc:1722] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.320526 5368 tablet.cc:1722] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.329900 5384 tablet.cc:1722] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.348636 5389 tablet.cc:1722] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.353772 5368 tablet.cc:1722] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.354369 5384 tablet.cc:1722] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.358860 5392 tablet.cc:1722] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.359592 5386 tablet.cc:1722] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.355872 5385 tablet.cc:1722] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.364372 5361 tablet.cc:1722] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20251215 20:54:13.412230 4930 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:32819, user_credentials={real_user=slave}} blocked reactor thread for 113890us
I20251215 20:54:13.413231 4960 raft_consensus.cc:606] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Received request to transfer leadership to TS 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:13.429109 5389 tablet.cc:1722] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20251215 20:54:13.438387 4931 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:43823, user_credentials={real_user=slave}} blocked reactor thread for 146123us
I20251215 20:54:13.445425 5381 tablet.cc:1722] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.446923 5350 raft_consensus.cc:993] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae: : Instructing follower 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:13.447901 5391 raft_consensus.cc:1081] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Signalling peer 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:13.450644 5111 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:46854
I20251215 20:54:13.451499 5111 raft_consensus.cc:493] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:13.452031 5111 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:13.452090 5369 tablet.cc:1722] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.451181 5385 tablet.cc:1722] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.473104 5361 tablet.cc:1722] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.476752 5392 tablet.cc:1722] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.482905 5111 raft_consensus.cc:515] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:13.486685 5111 leader_election.cc:290] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 3 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:13.488015 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:13.488801 5040 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:13.489619 4960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "415472a9bc7f4f0986c06200eeb8da12" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:13.490362 4960 raft_consensus.cc:3055] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:13.492409 4960 raft_consensus.cc:740] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:13.495311 5373 tablet.cc:1722] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.491217 5385 tablet.cc:1722] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.499168 4960 consensus_queue.cc:260] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:13.502040 4960 raft_consensus.cc:3060] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:13.502636 5363 tablet.cc:1722] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20251215 20:54:13.505040 5393 consensus_queue.cc:1175] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7adbc795f55441b6bccad811ca6f95c6" responder_term: 2 status { last_received { term: 2 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 2 index: 3 } }
I20251215 20:54:13.517457 5040 raft_consensus.cc:2468] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 3.
I20251215 20:54:13.520483 5080 leader_election.cc:304] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:13.521833 5355 raft_consensus.cc:2804] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:13.522361 5355 raft_consensus.cc:697] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 3 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:13.523353 5355 consensus_queue.cc:237] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
W20251215 20:54:13.527998 5006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:41493, user_credentials={real_user=slave}} blocked reactor thread for 82961.4us
W20251215 20:54:13.533706 5005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:32819, user_credentials={real_user=slave}} blocked reactor thread for 89938.9us
I20251215 20:54:13.539647 5368 tablet.cc:1722] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.541930 5384 tablet.cc:1722] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.559172 4863 catalog_manager.cc:5654] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 2 to 3, leader changed from c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129) to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 3 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:13.565519 4960 raft_consensus.cc:2468] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 3.
I20251215 20:54:13.589303 5361 tablet.cc:1722] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:13.603170 5040 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "778311f17c024c54800fdcd286efffbc"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
mode: GRACEFUL
new_leader_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:40598
I20251215 20:54:13.603994 5040 raft_consensus.cc:606] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Received request to transfer leadership to TS 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:13.605401 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20251215 20:54:13.606101 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:13.623924 5040 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52"
dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
mode: GRACEFUL
new_leader_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:40598
I20251215 20:54:13.624457 5040 raft_consensus.cc:606] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Received request to transfer leadership to TS 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:13.626641 4960 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642"
dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
mode: GRACEFUL
new_leader_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:34138
I20251215 20:54:13.627206 4960 raft_consensus.cc:606] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Received request to transfer leadership to TS 112ac20bd86a4be9a90456833a5c664d
I20251215 20:54:13.628577 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251215 20:54:13.629144 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:13.628697 4862 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a: soft_deleted_table [id=1b26593c762741f1a9f668267868c68d] alter complete (version 1)
I20251215 20:54:13.761399 5358 raft_consensus.cc:993] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae: : Instructing follower 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:13.761889 5393 raft_consensus.cc:1081] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Signalling peer 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:13.763302 5111 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:46854
I20251215 20:54:13.763722 5111 raft_consensus.cc:493] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:13.763998 5111 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:13.769052 5111 raft_consensus.cc:515] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:13.770473 5111 leader_election.cc:290] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 3 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:13.771232 4960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:13.771494 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6ca2cafde6344908c62983bdc54b642" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:13.771940 4960 raft_consensus.cc:3055] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:13.772096 5040 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:13.772397 4960 raft_consensus.cc:740] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1d56ae93a9e42e0b257f491deb526ae, State: Running, Role: LEADER
I20251215 20:54:13.773254 4960 consensus_queue.cc:260] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:13.774591 4960 raft_consensus.cc:3060] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:13.777896 5040 raft_consensus.cc:2468] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 3.
I20251215 20:54:13.779158 5080 leader_election.cc:304] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, 7adbc795f55441b6bccad811ca6f95c6; no voters:
I20251215 20:54:13.779974 5355 raft_consensus.cc:2804] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:13.780431 5355 raft_consensus.cc:697] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 3 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:13.781279 5355 consensus_queue.cc:237] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:13.783689 4960 raft_consensus.cc:2468] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 3.
I20251215 20:54:13.788990 4862 catalog_manager.cc:5654] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 2 to 3, leader changed from c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129) to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 3 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:13.816354 5325 raft_consensus.cc:993] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6: : Instructing follower 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:13.816799 5396 raft_consensus.cc:1081] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Signalling peer 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:13.817983 5111 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:46838
I20251215 20:54:13.818367 5111 raft_consensus.cc:493] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:13.818594 5111 raft_consensus.cc:3060] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:13.823173 5111 raft_consensus.cc:515] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:13.824631 5111 leader_election.cc:290] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 2 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:13.825241 4960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:13.825485 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77bd7419b1c44dd3a3e51a9737153b52" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:13.825853 4960 raft_consensus.cc:3060] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:13.825968 5040 raft_consensus.cc:3055] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:13.826337 5040 raft_consensus.cc:740] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:13.827020 5040 consensus_queue.cc:260] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:13.827978 5040 raft_consensus.cc:3060] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:13.830706 4960 raft_consensus.cc:2468] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 2.
I20251215 20:54:13.831676 5080 leader_election.cc:304] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:13.831990 5040 raft_consensus.cc:2468] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 2.
I20251215 20:54:13.832266 5355 raft_consensus.cc:2804] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:13.832746 5355 raft_consensus.cc:697] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 2 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:13.833504 5355 consensus_queue.cc:237] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:13.840108 4862 catalog_manager.cc:5654] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 1 to 2, leader changed from 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130) to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 2 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:13.984486 5040 raft_consensus.cc:1275] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251215 20:54:13.985535 5355 consensus_queue.cc:1048] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:13.995821 4960 raft_consensus.cc:1275] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251215 20:54:13.997114 5355 consensus_queue.cc:1048] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:14.181766 5325 raft_consensus.cc:993] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6: : Instructing follower 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:14.182166 5396 raft_consensus.cc:1081] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Signalling peer 112ac20bd86a4be9a90456833a5c664d to start an election
I20251215 20:54:14.183315 5111 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "778311f17c024c54800fdcd286efffbc"
dest_uuid: "112ac20bd86a4be9a90456833a5c664d"
from {username='slave'} at 127.0.0.1:46838
I20251215 20:54:14.183730 5111 raft_consensus.cc:493] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:14.183991 5111 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:14.189361 5111 raft_consensus.cc:515] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:14.190761 5111 leader_election.cc:290] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 3 election: Requested vote from peers c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493), 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823)
I20251215 20:54:14.191361 4960 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "778311f17c024c54800fdcd286efffbc" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c1d56ae93a9e42e0b257f491deb526ae"
I20251215 20:54:14.191593 5040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "778311f17c024c54800fdcd286efffbc" candidate_uuid: "112ac20bd86a4be9a90456833a5c664d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7adbc795f55441b6bccad811ca6f95c6"
I20251215 20:54:14.192020 4960 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:14.192075 5040 raft_consensus.cc:3055] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:14.192539 5040 raft_consensus.cc:740] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7adbc795f55441b6bccad811ca6f95c6, State: Running, Role: LEADER
I20251215 20:54:14.193091 5040 consensus_queue.cc:260] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:14.193921 5040 raft_consensus.cc:3060] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:14.196686 4960 raft_consensus.cc:2468] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 3.
I20251215 20:54:14.197496 5080 leader_election.cc:304] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 112ac20bd86a4be9a90456833a5c664d, c1d56ae93a9e42e0b257f491deb526ae; no voters:
I20251215 20:54:14.197937 5040 raft_consensus.cc:2468] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 112ac20bd86a4be9a90456833a5c664d in term 3.
I20251215 20:54:14.198179 5355 raft_consensus.cc:2804] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:14.198622 5355 raft_consensus.cc:697] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 3 LEADER]: Becoming Leader. State: Replica: 112ac20bd86a4be9a90456833a5c664d, State: Running, Role: LEADER
I20251215 20:54:14.199361 5355 consensus_queue.cc:237] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } }
I20251215 20:54:14.205030 4863 catalog_manager.cc:5654] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d reported cstate change: term changed from 2 to 3, leader changed from 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130) to 112ac20bd86a4be9a90456833a5c664d (127.0.106.131). New cstate: current_term: 3 leader_uuid: "112ac20bd86a4be9a90456833a5c664d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "112ac20bd86a4be9a90456833a5c664d" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 32819 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:14.269385 4960 raft_consensus.cc:1275] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:14.270457 5355 consensus_queue.cc:1048] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:14.278208 5037 raft_consensus.cc:1275] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:14.279702 5406 consensus_queue.cc:1048] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:14.312026 4960 raft_consensus.cc:1275] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:14.313045 5406 consensus_queue.cc:1048] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:14.321694 5037 raft_consensus.cc:1275] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:14.322994 5355 consensus_queue.cc:1048] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:14.599917 5037 raft_consensus.cc:1275] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251215 20:54:14.601007 5355 consensus_queue.cc:1048] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adbc795f55441b6bccad811ca6f95c6" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 43823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:14.608866 4962 raft_consensus.cc:1275] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Refusing update from remote peer 112ac20bd86a4be9a90456833a5c664d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251215 20:54:14.610705 5324 consensus_queue.cc:1048] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d56ae93a9e42e0b257f491deb526ae" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:14.630168 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:14.635444 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:14.635789 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:14.640373 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:14.640689 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:15.641396 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:15.646138 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:15.646484 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:15.651574 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:15.651901 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:16.652680 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:16.657238 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:16.657573 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:16.661867 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:16.662174 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:17.662941 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:17.667488 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:17.667850 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:17.672726 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:17.673041 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:18.673844 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:18.678598 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:18.678944 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:18.683704 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:18.684019 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:19.684803 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:19.689553 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:19.689898 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:19.694717 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:19.695041 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:20.695817 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:20.700335 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:20.700675 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:20.705139 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:20.705444 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:21.706238 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:21.711813 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:21.712317 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:21.717378 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:21.717650 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:22.718540 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20251215 20:54:22.724315 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20251215 20:54:22.724660 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:22.729144 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:22.729456 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:23.781498 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
I20251215 20:54:23.813686 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:23.814544 426 tablet_replica.cc:333] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.815539 426 raft_consensus.cc:2243] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.816426 426 raft_consensus.cc:2272] T 73bd702697d94bef938bc47293ef6145 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.819041 426 tablet_replica.cc:333] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.819615 426 raft_consensus.cc:2243] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.820159 426 raft_consensus.cc:2272] T 30078c1b709e48f683bf789b6b713cbd P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.822659 426 tablet_replica.cc:333] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.823284 426 raft_consensus.cc:2243] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:23.824261 426 raft_consensus.cc:2272] T b4fa4ed1647f4a28ac1de074ee2e7b5e P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.826589 426 tablet_replica.cc:333] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.827164 426 raft_consensus.cc:2243] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.827755 426 raft_consensus.cc:2272] T 415472a9bc7f4f0986c06200eeb8da12 P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.830123 426 tablet_replica.cc:333] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.830737 426 raft_consensus.cc:2243] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:23.831699 426 raft_consensus.cc:2272] T ed719c77ae6b42f98c1e11fdfaa4a86d P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.834005 426 tablet_replica.cc:333] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.834512 426 raft_consensus.cc:2243] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.835036 426 raft_consensus.cc:2272] T 77bd7419b1c44dd3a3e51a9737153b52 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.837177 426 tablet_replica.cc:333] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.837716 426 raft_consensus.cc:2243] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.838265 426 raft_consensus.cc:2272] T d9e71d96233a4ebd99e5927a05efdd45 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.840822 426 tablet_replica.cc:333] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.841383 426 raft_consensus.cc:2243] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Raft consensus shutting down.
W20251215 20:54:23.841578 5080 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 85 similar messages]
I20251215 20:54:23.841917 426 raft_consensus.cc:2272] T e6ca2cafde6344908c62983bdc54b642 P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.844821 426 tablet_replica.cc:333] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
W20251215 20:54:23.844851 5080 consensus_peers.cc:597] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d -> Peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Couldn't send request to peer c1d56ae93a9e42e0b257f491deb526ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:23.845523 426 raft_consensus.cc:2243] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:23.846315 426 raft_consensus.cc:2272] T 3baa177654f34e04a16b0024a32bcbb2 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.848232 426 tablet_replica.cc:333] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.848755 426 raft_consensus.cc:2243] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.849241 426 raft_consensus.cc:2272] T 5f941295517b416faf90ed92f6a86731 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.851289 426 tablet_replica.cc:333] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.851763 426 raft_consensus.cc:2243] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.852171 426 raft_consensus.cc:2272] T 8f89ce175118468590c163a82684f58d P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.854238 426 tablet_replica.cc:333] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.854700 426 raft_consensus.cc:2243] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.855197 426 raft_consensus.cc:2272] T 8c9900d3933a4ba79c7753485e3754d4 P c1d56ae93a9e42e0b257f491deb526ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.857191 426 tablet_replica.cc:333] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.857640 426 raft_consensus.cc:2243] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.858119 426 raft_consensus.cc:2272] T 4609948393fc4c0a98313eddb4c52917 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.860226 426 tablet_replica.cc:333] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.860780 426 raft_consensus.cc:2243] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:23.861582 426 raft_consensus.cc:2272] T a95f03f628c6421ba58a7ae937e1c539 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.863550 426 tablet_replica.cc:333] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.864013 426 raft_consensus.cc:2243] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:23.864889 426 raft_consensus.cc:2272] T 0e4d9d75a8b8414091c31038c21d0405 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.866871 426 tablet_replica.cc:333] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.867336 426 raft_consensus.cc:2243] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.867831 426 raft_consensus.cc:2272] T 778311f17c024c54800fdcd286efffbc P c1d56ae93a9e42e0b257f491deb526ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.869743 426 tablet_replica.cc:333] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.870214 426 raft_consensus.cc:2243] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.870684 426 raft_consensus.cc:2272] T 1f9bc5301f3f4050a2453e0f7f8d6346 P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.872656 426 tablet_replica.cc:333] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae: stopping tablet replica
I20251215 20:54:23.873091 426 raft_consensus.cc:2243] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:23.873979 426 raft_consensus.cc:2272] T 95ebe2c267704faeb129378e03859d4f P c1d56ae93a9e42e0b257f491deb526ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.917049 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20251215 20:54:23.951316 5006 consensus_peers.cc:597] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 -> Peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Couldn't send request to peer c1d56ae93a9e42e0b257f491deb526ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:23.956110 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20251215 20:54:23.957345 5006 consensus_peers.cc:597] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 -> Peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Couldn't send request to peer c1d56ae93a9e42e0b257f491deb526ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:23.962519 5080 consensus_peers.cc:597] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d -> Peer 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823): Couldn't send request to peer 7adbc795f55441b6bccad811ca6f95c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:23.985339 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20251215 20:54:23.986117 5006 consensus_peers.cc:597] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 -> Peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Couldn't send request to peer c1d56ae93a9e42e0b257f491deb526ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:23.986131 426 tablet_replica.cc:333] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:23.987082 426 raft_consensus.cc:2243] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.987691 426 raft_consensus.cc:2272] T 30078c1b709e48f683bf789b6b713cbd P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.989907 426 tablet_replica.cc:333] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:23.990391 426 raft_consensus.cc:2243] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.990865 426 raft_consensus.cc:2272] T 415472a9bc7f4f0986c06200eeb8da12 P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:23.993569 426 tablet_replica.cc:333] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:23.994155 426 raft_consensus.cc:2243] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:23.995273 426 raft_consensus.cc:2272] T 73bd702697d94bef938bc47293ef6145 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:23.996059 5080 consensus_peers.cc:597] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d -> Peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Couldn't send request to peer c1d56ae93a9e42e0b257f491deb526ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:23.997551 426 tablet_replica.cc:333] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:23.998188 426 raft_consensus.cc:2243] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:23.998631 426 raft_consensus.cc:2272] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.000571 426 tablet_replica.cc:333] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.001051 426 raft_consensus.cc:2243] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.001817 426 raft_consensus.cc:2272] T 8f89ce175118468590c163a82684f58d P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.003607 426 tablet_replica.cc:333] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.004096 426 raft_consensus.cc:2243] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.004868 426 raft_consensus.cc:2272] T 5f941295517b416faf90ed92f6a86731 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.006836 426 tablet_replica.cc:333] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.007310 426 raft_consensus.cc:2243] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.007730 426 raft_consensus.cc:2272] T ed719c77ae6b42f98c1e11fdfaa4a86d P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.009941 426 tablet_replica.cc:333] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.010438 426 raft_consensus.cc:2243] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.010825 426 raft_consensus.cc:2272] T 77bd7419b1c44dd3a3e51a9737153b52 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.012673 426 tablet_replica.cc:333] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.013170 426 raft_consensus.cc:2243] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.013605 426 raft_consensus.cc:2272] T e6ca2cafde6344908c62983bdc54b642 P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.015419 426 tablet_replica.cc:333] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.015854 426 raft_consensus.cc:2243] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.016625 426 raft_consensus.cc:2272] T d9e71d96233a4ebd99e5927a05efdd45 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.018406 426 tablet_replica.cc:333] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.018858 426 raft_consensus.cc:2243] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.019268 426 raft_consensus.cc:2272] T 3baa177654f34e04a16b0024a32bcbb2 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.021066 426 tablet_replica.cc:333] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.021502 426 raft_consensus.cc:2243] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.022192 426 raft_consensus.cc:2272] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.024026 426 tablet_replica.cc:333] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.024544 426 raft_consensus.cc:2243] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.024993 426 raft_consensus.cc:2272] T 95ebe2c267704faeb129378e03859d4f P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.026827 426 tablet_replica.cc:333] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.027297 426 raft_consensus.cc:2243] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.028059 426 raft_consensus.cc:2272] T 8c9900d3933a4ba79c7753485e3754d4 P 7adbc795f55441b6bccad811ca6f95c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.029855 426 tablet_replica.cc:333] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.030287 426 raft_consensus.cc:2243] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.030761 426 raft_consensus.cc:2272] T 4609948393fc4c0a98313eddb4c52917 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.032521 426 tablet_replica.cc:333] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.032941 426 raft_consensus.cc:2243] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.033344 426 raft_consensus.cc:2272] T 778311f17c024c54800fdcd286efffbc P 7adbc795f55441b6bccad811ca6f95c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.035157 426 tablet_replica.cc:333] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.035646 426 raft_consensus.cc:2243] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.036100 426 raft_consensus.cc:2272] T a95f03f628c6421ba58a7ae937e1c539 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.037892 426 tablet_replica.cc:333] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6: stopping tablet replica
I20251215 20:54:24.038269 426 raft_consensus.cc:2243] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.038638 426 raft_consensus.cc:2272] T 0e4d9d75a8b8414091c31038c21d0405 P 7adbc795f55441b6bccad811ca6f95c6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:24.049760 5080 consensus_peers.cc:597] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d -> Peer 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823): Couldn't send request to peer 7adbc795f55441b6bccad811ca6f95c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:24.077586 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
W20251215 20:54:24.087576 5080 consensus_peers.cc:597] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d -> Peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Couldn't send request to peer c1d56ae93a9e42e0b257f491deb526ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:24.112136 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
W20251215 20:54:24.113013 5080 consensus_peers.cc:597] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d -> Peer 7adbc795f55441b6bccad811ca6f95c6 (127.0.106.130:43823): Couldn't send request to peer 7adbc795f55441b6bccad811ca6f95c6. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:43823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:24.118899 5080 consensus_peers.cc:597] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d -> Peer c1d56ae93a9e42e0b257f491deb526ae (127.0.106.129:41493): Couldn't send request to peer c1d56ae93a9e42e0b257f491deb526ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:24.141360 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:24.142030 426 tablet_replica.cc:333] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.142683 426 raft_consensus.cc:2243] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.143519 426 raft_consensus.cc:2272] T 415472a9bc7f4f0986c06200eeb8da12 P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.145704 426 tablet_replica.cc:333] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.146260 426 raft_consensus.cc:2243] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.146708 426 raft_consensus.cc:2272] T b4fa4ed1647f4a28ac1de074ee2e7b5e P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.148591 426 tablet_replica.cc:333] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.149137 426 raft_consensus.cc:2243] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.149551 426 raft_consensus.cc:2272] T 73bd702697d94bef938bc47293ef6145 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.151410 426 tablet_replica.cc:333] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.151889 426 raft_consensus.cc:2243] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.152685 426 raft_consensus.cc:2272] T 30078c1b709e48f683bf789b6b713cbd P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.154443 426 tablet_replica.cc:333] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.154949 426 raft_consensus.cc:2243] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.155406 426 raft_consensus.cc:2272] T ed719c77ae6b42f98c1e11fdfaa4a86d P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.157140 426 tablet_replica.cc:333] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.157621 426 raft_consensus.cc:2243] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.158057 426 raft_consensus.cc:2272] T 8c9900d3933a4ba79c7753485e3754d4 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.159773 426 tablet_replica.cc:333] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.160236 426 raft_consensus.cc:2243] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.160995 426 raft_consensus.cc:2272] T 4609948393fc4c0a98313eddb4c52917 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.162706 426 tablet_replica.cc:333] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.163223 426 raft_consensus.cc:2243] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.163947 426 raft_consensus.cc:2272] T 77bd7419b1c44dd3a3e51a9737153b52 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.165683 426 tablet_replica.cc:333] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.166115 426 raft_consensus.cc:2243] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.166488 426 raft_consensus.cc:2272] T 1f9bc5301f3f4050a2453e0f7f8d6346 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.168146 426 tablet_replica.cc:333] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.168619 426 raft_consensus.cc:2243] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.169036 426 raft_consensus.cc:2272] T 95ebe2c267704faeb129378e03859d4f P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.170694 426 tablet_replica.cc:333] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.171125 426 raft_consensus.cc:2243] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.171814 426 raft_consensus.cc:2272] T e6ca2cafde6344908c62983bdc54b642 P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.173483 426 tablet_replica.cc:333] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.173923 426 raft_consensus.cc:2243] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.174270 426 raft_consensus.cc:2272] T 3baa177654f34e04a16b0024a32bcbb2 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.175969 426 tablet_replica.cc:333] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.176450 426 raft_consensus.cc:2243] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.176843 426 raft_consensus.cc:2272] T d9e71d96233a4ebd99e5927a05efdd45 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.178524 426 tablet_replica.cc:333] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.178928 426 raft_consensus.cc:2243] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.179323 426 raft_consensus.cc:2272] T 5f941295517b416faf90ed92f6a86731 P 112ac20bd86a4be9a90456833a5c664d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.181036 426 tablet_replica.cc:333] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.181455 426 raft_consensus.cc:2243] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.181849 426 raft_consensus.cc:2272] T 8f89ce175118468590c163a82684f58d P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.183493 426 tablet_replica.cc:333] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.183881 426 raft_consensus.cc:2243] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.184325 426 raft_consensus.cc:2272] T a95f03f628c6421ba58a7ae937e1c539 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.186023 426 tablet_replica.cc:333] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.186443 426 raft_consensus.cc:2243] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.187127 426 raft_consensus.cc:2272] T 778311f17c024c54800fdcd286efffbc P 112ac20bd86a4be9a90456833a5c664d [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.188875 426 tablet_replica.cc:333] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d: stopping tablet replica
I20251215 20:54:24.189242 426 raft_consensus.cc:2243] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:24.189635 426 raft_consensus.cc:2272] T 0e4d9d75a8b8414091c31038c21d0405 P 112ac20bd86a4be9a90456833a5c664d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.224673 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20251215 20:54:24.261790 426 master.cc:561] Master@127.0.106.190:44937 shutting down...
I20251215 20:54:24.281771 426 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:24.282318 426 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:24.282634 426 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2d19afe3804a4768a5553fce0a578d2a: stopping tablet replica
I20251215 20:54:24.301528 426 master.cc:583] Master@127.0.106.190:44937 shutdown complete.
[ OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (19919 ms)
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20251215 20:54:24.347290 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:41463
I20251215 20:54:24.348402 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:54:24.353545 5435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:24.353961 5436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:24.354664 5438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:24.354847 426 server_base.cc:1047] running on GCE node
I20251215 20:54:24.355753 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:54:24.355945 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:54:24.356068 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832064356057 us; error 0 us; skew 500 ppm
I20251215 20:54:24.356534 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:54:24.358678 426 webserver.cc:492] Webserver started at http://127.0.106.190:36405/ using document root <none> and password file <none>
I20251215 20:54:24.359105 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:54:24.359288 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:54:24.359493 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:54:24.361011 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/master-0-root/instance:
uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57"
format_stamp: "Formatted at 2025-12-15 20:54:24 on dist-test-slave-xp5d"
I20251215 20:54:24.364984 426 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20251215 20:54:24.367969 5443 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.368736 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251215 20:54:24.368970 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/master-0-root
uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57"
format_stamp: "Formatted at 2025-12-15 20:54:24 on dist-test-slave-xp5d"
I20251215 20:54:24.369194 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:54:24.377532 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:54:24.378547 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:54:24.413425 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:41463
I20251215 20:54:24.413522 5494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:41463 every 8 connection(s)
I20251215 20:54:24.417001 5495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.427260 5495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57: Bootstrap starting.
I20251215 20:54:24.431905 5495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:24.435631 5495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57: No bootstrap required, opened a new log
I20251215 20:54:24.437568 5495 raft_consensus.cc:359] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57" member_type: VOTER }
I20251215 20:54:24.437950 5495 raft_consensus.cc:385] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:24.438162 5495 raft_consensus.cc:740] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ffa91dd7a14edf9b0fd9d4c6df5e57, State: Initialized, Role: FOLLOWER
I20251215 20:54:24.438700 5495 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57" member_type: VOTER }
I20251215 20:54:24.439136 5495 raft_consensus.cc:399] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251215 20:54:24.439352 5495 raft_consensus.cc:493] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251215 20:54:24.439597 5495 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:24.443509 5495 raft_consensus.cc:515] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57" member_type: VOTER }
I20251215 20:54:24.443962 5495 leader_election.cc:304] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8ffa91dd7a14edf9b0fd9d4c6df5e57; no voters:
I20251215 20:54:24.444995 5495 leader_election.cc:290] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251215 20:54:24.445330 5498 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:24.446538 5498 raft_consensus.cc:697] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 1 LEADER]: Becoming Leader. State: Replica: d8ffa91dd7a14edf9b0fd9d4c6df5e57, State: Running, Role: LEADER
I20251215 20:54:24.447172 5498 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57" member_type: VOTER }
I20251215 20:54:24.447714 5495 sys_catalog.cc:565] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [sys.catalog]: configured and running, proceeding with master startup.
I20251215 20:54:24.452963 5499 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57" member_type: VOTER } }
I20251215 20:54:24.453086 5500 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8ffa91dd7a14edf9b0fd9d4c6df5e57. Latest consensus state: current_term: 1 leader_uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ffa91dd7a14edf9b0fd9d4c6df5e57" member_type: VOTER } }
I20251215 20:54:24.453691 5499 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [sys.catalog]: This master's current role is: LEADER
I20251215 20:54:24.453761 5500 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [sys.catalog]: This master's current role is: LEADER
I20251215 20:54:24.460246 5506 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251215 20:54:24.466755 5506 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251215 20:54:24.467617 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251215 20:54:24.474720 5506 catalog_manager.cc:1357] Generated new cluster ID: 44a304d99abd4ccea955f7cc46e7b675
I20251215 20:54:24.474938 5506 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251215 20:54:24.498906 5506 catalog_manager.cc:1380] Generated new certificate authority record
I20251215 20:54:24.500047 5506 catalog_manager.cc:1514] Loading token signing keys...
I20251215 20:54:24.514729 5506 catalog_manager.cc:6027] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57: Generated new TSK 0
I20251215 20:54:24.515218 5506 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251215 20:54:24.533793 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:54:24.539040 5516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:24.539882 5517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:24.541164 5519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:24.541577 426 server_base.cc:1047] running on GCE node
I20251215 20:54:24.542388 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:54:24.542567 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:54:24.542707 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832064542692 us; error 0 us; skew 500 ppm
I20251215 20:54:24.543166 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:54:24.545225 426 webserver.cc:492] Webserver started at http://127.0.106.129:37631/ using document root <none> and password file <none>
I20251215 20:54:24.545643 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:54:24.545806 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:54:24.546027 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:54:24.546995 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-0-root/instance:
uuid: "9ac534568c51434db437a84eb004db52"
format_stamp: "Formatted at 2025-12-15 20:54:24 on dist-test-slave-xp5d"
I20251215 20:54:24.550992 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20251215 20:54:24.553808 5524 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.554459 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251215 20:54:24.554701 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-0-root
uuid: "9ac534568c51434db437a84eb004db52"
format_stamp: "Formatted at 2025-12-15 20:54:24 on dist-test-slave-xp5d"
I20251215 20:54:24.554939 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:54:24.573645 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:54:24.574697 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:54:24.575973 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:54:24.577987 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:54:24.578166 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.578377 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:54:24.578516 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.614730 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:37493
I20251215 20:54:24.614813 5586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:37493 every 8 connection(s)
I20251215 20:54:24.619043 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:54:24.625924 5591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:24.627244 5592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:24.629024 426 server_base.cc:1047] running on GCE node
W20251215 20:54:24.629494 5594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:24.630543 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:54:24.630725 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:54:24.630877 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832064630865 us; error 0 us; skew 500 ppm
I20251215 20:54:24.631474 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:54:24.634084 5587 heartbeater.cc:344] Connected to a master server at 127.0.106.190:41463
I20251215 20:54:24.634420 5587 heartbeater.cc:461] Registering TS with master...
I20251215 20:54:24.634652 426 webserver.cc:492] Webserver started at http://127.0.106.130:45055/ using document root <none> and password file <none>
I20251215 20:54:24.635123 5587 heartbeater.cc:507] Master 127.0.106.190:41463 requested a full tablet report, sending...
I20251215 20:54:24.635149 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:54:24.635519 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:54:24.635761 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:54:24.636998 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-1-root/instance:
uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
format_stamp: "Formatted at 2025-12-15 20:54:24 on dist-test-slave-xp5d"
I20251215 20:54:24.637060 5460 ts_manager.cc:194] Registered new tserver with Master: 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493)
I20251215 20:54:24.638742 5460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35608
I20251215 20:54:24.641396 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20251215 20:54:24.644464 5599 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.645087 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251215 20:54:24.645344 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-1-root
uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
format_stamp: "Formatted at 2025-12-15 20:54:24 on dist-test-slave-xp5d"
I20251215 20:54:24.645586 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:54:24.658113 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:54:24.659133 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:54:24.660462 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:54:24.662401 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:54:24.662578 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.662783 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:54:24.662925 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.699064 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:34951
I20251215 20:54:24.699156 5661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:34951 every 8 connection(s)
I20251215 20:54:24.703469 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 20:54:24.709887 5665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:24.710525 5666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 20:54:24.713302 5668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 20:54:24.714612 426 server_base.cc:1047] running on GCE node
I20251215 20:54:24.714974 5662 heartbeater.cc:344] Connected to a master server at 127.0.106.190:41463
I20251215 20:54:24.715471 5662 heartbeater.cc:461] Registering TS with master...
I20251215 20:54:24.715634 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251215 20:54:24.715965 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251215 20:54:24.716166 426 hybrid_clock.cc:648] HybridClock initialized: now 1765832064716145 us; error 0 us; skew 500 ppm
I20251215 20:54:24.716352 5662 heartbeater.cc:507] Master 127.0.106.190:41463 requested a full tablet report, sending...
I20251215 20:54:24.716892 426 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 20:54:24.718892 5460 ts_manager.cc:194] Registered new tserver with Master: f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:24.720280 426 webserver.cc:492] Webserver started at http://127.0.106.131:38775/ using document root <none> and password file <none>
I20251215 20:54:24.720640 5460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35612
I20251215 20:54:24.720963 426 fs_manager.cc:362] Metadata directory not provided
I20251215 20:54:24.721246 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 20:54:24.721555 426 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 20:54:24.722911 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-2-root/instance:
uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
format_stamp: "Formatted at 2025-12-15 20:54:24 on dist-test-slave-xp5d"
I20251215 20:54:24.726960 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20251215 20:54:24.729843 5673 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.730487 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251215 20:54:24.730736 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-2-root
uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
format_stamp: "Formatted at 2025-12-15 20:54:24 on dist-test-slave-xp5d"
I20251215 20:54:24.730975 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 20:54:24.748802 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 20:54:24.750111 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 20:54:24.751645 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 20:54:24.753633 426 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 20:54:24.753815 426 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.754015 426 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 20:54:24.754155 426 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 20:54:24.790680 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:42761
I20251215 20:54:24.790777 5735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:42761 every 8 connection(s)
I20251215 20:54:24.802597 5736 heartbeater.cc:344] Connected to a master server at 127.0.106.190:41463
I20251215 20:54:24.802953 5736 heartbeater.cc:461] Registering TS with master...
I20251215 20:54:24.803596 5736 heartbeater.cc:507] Master 127.0.106.190:41463 requested a full tablet report, sending...
I20251215 20:54:24.805243 5460 ts_manager.cc:194] Registered new tserver with Master: ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:24.805613 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01200199s
I20251215 20:54:24.806483 5460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35616
I20251215 20:54:24.807693 426 test_util.cc:276] Using random seed: -789269765
I20251215 20:54:24.826947 5460 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35630:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 20:54:24.829540 5460 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 20:54:24.892128 5552 tablet_service.cc:1505] Processing CreateTablet for tablet c13de8b1518d44739e99be20483c275b (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:24.893486 5552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13de8b1518d44739e99be20483c275b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.902331 5551 tablet_service.cc:1505] Processing CreateTablet for tablet 49cc5941ee674923ac97bde1cb66b06f (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:24.903633 5551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49cc5941ee674923ac97bde1cb66b06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.909392 5550 tablet_service.cc:1505] Processing CreateTablet for tablet 462e94dfc865452fa0db5814f01e7001 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:24.911655 5700 tablet_service.cc:1505] Processing CreateTablet for tablet 49cc5941ee674923ac97bde1cb66b06f (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:24.912496 5550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462e94dfc865452fa0db5814f01e7001. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.913075 5701 tablet_service.cc:1505] Processing CreateTablet for tablet c13de8b1518d44739e99be20483c275b (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:24.913115 5700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49cc5941ee674923ac97bde1cb66b06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.915213 5548 tablet_service.cc:1505] Processing CreateTablet for tablet b9bcb474df1d47db9f8c873f18d61aa0 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:24.916483 5548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bcb474df1d47db9f8c873f18d61aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.917268 5697 tablet_service.cc:1505] Processing CreateTablet for tablet b9bcb474df1d47db9f8c873f18d61aa0 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:24.917363 5698 tablet_service.cc:1505] Processing CreateTablet for tablet dff425fa89ff4eb5bb324154298bfd5d (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:24.918608 5697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bcb474df1d47db9f8c873f18d61aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.915940 5699 tablet_service.cc:1505] Processing CreateTablet for tablet 462e94dfc865452fa0db5814f01e7001 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:24.919626 5699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462e94dfc865452fa0db5814f01e7001. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.914141 5547 tablet_service.cc:1505] Processing CreateTablet for tablet 9095c04828a243cf986895f9ad500b4c (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:24.920766 5549 tablet_service.cc:1505] Processing CreateTablet for tablet dff425fa89ff4eb5bb324154298bfd5d (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:24.921695 5547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9095c04828a243cf986895f9ad500b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.922303 5549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff425fa89ff4eb5bb324154298bfd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.923130 5701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13de8b1518d44739e99be20483c275b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.927765 5698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff425fa89ff4eb5bb324154298bfd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.937631 5696 tablet_service.cc:1505] Processing CreateTablet for tablet 9095c04828a243cf986895f9ad500b4c (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:24.938930 5696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9095c04828a243cf986895f9ad500b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.938923 5546 tablet_service.cc:1505] Processing CreateTablet for tablet ef3e90b779264349adea5ecfa16f0925 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:24.941640 5546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3e90b779264349adea5ecfa16f0925. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.969940 5695 tablet_service.cc:1505] Processing CreateTablet for tablet ef3e90b779264349adea5ecfa16f0925 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:24.971488 5695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3e90b779264349adea5ecfa16f0925. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.977923 5550 tablet_service.cc:1505] Processing CreateTablet for tablet d4432e6787ca40df96ccb85f083448a1 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:24.979813 5627 tablet_service.cc:1505] Processing CreateTablet for tablet c13de8b1518d44739e99be20483c275b (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:24.987349 5622 tablet_service.cc:1505] Processing CreateTablet for tablet 9095c04828a243cf986895f9ad500b4c (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:24.988364 5627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13de8b1518d44739e99be20483c275b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.988821 5545 tablet_service.cc:1505] Processing CreateTablet for tablet f267b5f2804642939f1b2cb3c4c54545 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:24.989439 5621 tablet_service.cc:1505] Processing CreateTablet for tablet ef3e90b779264349adea5ecfa16f0925 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:24.990020 5545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f267b5f2804642939f1b2cb3c4c54545. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.990634 5621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3e90b779264349adea5ecfa16f0925. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.981416 5626 tablet_service.cc:1505] Processing CreateTablet for tablet 49cc5941ee674923ac97bde1cb66b06f (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:24.993172 5626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49cc5941ee674923ac97bde1cb66b06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.995570 5751 tablet_bootstrap.cc:492] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:24.997287 5620 tablet_service.cc:1505] Processing CreateTablet for tablet d4432e6787ca40df96ccb85f083448a1 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:24.998507 5620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4432e6787ca40df96ccb85f083448a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.983017 5625 tablet_service.cc:1505] Processing CreateTablet for tablet 462e94dfc865452fa0db5814f01e7001 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:25.000946 5550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4432e6787ca40df96ccb85f083448a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:25.001164 5625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462e94dfc865452fa0db5814f01e7001. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:25.001833 5619 tablet_service.cc:1505] Processing CreateTablet for tablet f267b5f2804642939f1b2cb3c4c54545 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:25.002980 5619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f267b5f2804642939f1b2cb3c4c54545. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.984623 5624 tablet_service.cc:1505] Processing CreateTablet for tablet dff425fa89ff4eb5bb324154298bfd5d (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:25.004621 5624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff425fa89ff4eb5bb324154298bfd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.986243 5694 tablet_service.cc:1505] Processing CreateTablet for tablet d4432e6787ca40df96ccb85f083448a1 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:25.008380 5751 tablet_bootstrap.cc:654] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.009087 5694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4432e6787ca40df96ccb85f083448a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:24.986243 5623 tablet_service.cc:1505] Processing CreateTablet for tablet b9bcb474df1d47db9f8c873f18d61aa0 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:25.011600 5623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bcb474df1d47db9f8c873f18d61aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:25.015087 5622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9095c04828a243cf986895f9ad500b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:25.019868 5695 tablet_service.cc:1505] Processing CreateTablet for tablet f267b5f2804642939f1b2cb3c4c54545 (DEFAULT_TABLE table=test-workload [id=ac85980fbdec4493a6d71ecd3d709739]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:25.021088 5695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f267b5f2804642939f1b2cb3c4c54545. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:25.030299 5752 tablet_bootstrap.cc:492] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.037385 5752 tablet_bootstrap.cc:654] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.058848 5752 tablet_bootstrap.cc:492] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.059449 5752 ts_tablet_manager.cc:1403] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.000s
I20251215 20:54:25.062354 5752 raft_consensus.cc:359] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.063253 5752 raft_consensus.cc:385] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.063614 5752 raft_consensus.cc:740] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.064541 5752 consensus_queue.cc:260] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.073581 5752 ts_tablet_manager.cc:1434] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.014s user 0.002s sys 0.010s
I20251215 20:54:25.073688 5736 heartbeater.cc:499] Master 127.0.106.190:41463 was elected leader, sending a full tablet report...
I20251215 20:54:25.074679 5752 tablet_bootstrap.cc:492] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.080960 5752 tablet_bootstrap.cc:654] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.102244 5754 tablet_bootstrap.cc:492] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.106814 5751 tablet_bootstrap.cc:492] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.107374 5751 ts_tablet_manager.cc:1403] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.112s user 0.026s sys 0.031s
I20251215 20:54:25.108680 5754 tablet_bootstrap.cc:654] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.110627 5752 tablet_bootstrap.cc:492] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.110793 5751 raft_consensus.cc:359] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.111333 5752 ts_tablet_manager.cc:1403] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.037s user 0.021s sys 0.011s
I20251215 20:54:25.111518 5751 raft_consensus.cc:385] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.111867 5751 raft_consensus.cc:740] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.112607 5751 consensus_queue.cc:260] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.114233 5752 raft_consensus.cc:359] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.115056 5752 raft_consensus.cc:385] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.115402 5752 raft_consensus.cc:740] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.116282 5752 consensus_queue.cc:260] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.118968 5587 heartbeater.cc:499] Master 127.0.106.190:41463 was elected leader, sending a full tablet report...
I20251215 20:54:25.119565 5751 ts_tablet_manager.cc:1434] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20251215 20:54:25.120467 5752 ts_tablet_manager.cc:1434] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20251215 20:54:25.120625 5751 tablet_bootstrap.cc:492] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:25.121413 5752 tablet_bootstrap.cc:492] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.124322 5754 tablet_bootstrap.cc:492] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.124852 5754 ts_tablet_manager.cc:1403] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.007s
I20251215 20:54:25.126578 5751 tablet_bootstrap.cc:654] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.127696 5752 tablet_bootstrap.cc:654] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.127609 5754 raft_consensus.cc:359] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.128511 5754 raft_consensus.cc:385] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.128852 5754 raft_consensus.cc:740] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.129571 5754 consensus_queue.cc:260] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.136139 5754 ts_tablet_manager.cc:1434] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.011s user 0.001s sys 0.008s
I20251215 20:54:25.136799 5662 heartbeater.cc:499] Master 127.0.106.190:41463 was elected leader, sending a full tablet report...
I20251215 20:54:25.140856 5754 tablet_bootstrap.cc:492] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.147022 5754 tablet_bootstrap.cc:654] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.149945 5752 tablet_bootstrap.cc:492] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.150511 5752 ts_tablet_manager.cc:1403] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.029s user 0.018s sys 0.008s
I20251215 20:54:25.153424 5752 raft_consensus.cc:359] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.154306 5752 raft_consensus.cc:385] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.154656 5752 raft_consensus.cc:740] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.155455 5752 consensus_queue.cc:260] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.157915 5752 ts_tablet_manager.cc:1434] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:54:25.158980 5752 tablet_bootstrap.cc:492] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.165247 5752 tablet_bootstrap.cc:654] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.189050 5751 tablet_bootstrap.cc:492] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.189529 5751 ts_tablet_manager.cc:1403] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.069s user 0.024s sys 0.043s
I20251215 20:54:25.189888 5754 tablet_bootstrap.cc:492] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.189949 5752 tablet_bootstrap.cc:492] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.190373 5754 ts_tablet_manager.cc:1403] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.050s user 0.024s sys 0.023s
I20251215 20:54:25.190508 5752 ts_tablet_manager.cc:1403] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.032s user 0.014s sys 0.017s
I20251215 20:54:25.192144 5751 raft_consensus.cc:359] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.192437 5754 raft_consensus.cc:359] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.192894 5751 raft_consensus.cc:385] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.192997 5754 raft_consensus.cc:385] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.193338 5751 raft_consensus.cc:740] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.193423 5754 raft_consensus.cc:740] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.193154 5752 raft_consensus.cc:359] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.194033 5752 raft_consensus.cc:385] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.194339 5752 raft_consensus.cc:740] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.194192 5751 consensus_queue.cc:260] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.194350 5754 consensus_queue.cc:260] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.196550 5751 ts_tablet_manager.cc:1434] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20251215 20:54:25.197329 5754 ts_tablet_manager.cc:1434] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.007s user 0.001s sys 0.004s
I20251215 20:54:25.195010 5752 consensus_queue.cc:260] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.197499 5751 tablet_bootstrap.cc:492] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:25.198294 5754 tablet_bootstrap.cc:492] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.201154 5752 ts_tablet_manager.cc:1434] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20251215 20:54:25.202158 5752 tablet_bootstrap.cc:492] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.205088 5751 tablet_bootstrap.cc:654] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.206915 5754 tablet_bootstrap.cc:654] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.207980 5752 tablet_bootstrap.cc:654] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.215569 5754 tablet_bootstrap.cc:492] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.216114 5754 ts_tablet_manager.cc:1403] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.008s
I20251215 20:54:25.219082 5754 raft_consensus.cc:359] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.220463 5754 raft_consensus.cc:385] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.220768 5754 raft_consensus.cc:740] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.221482 5754 consensus_queue.cc:260] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.222298 5751 tablet_bootstrap.cc:492] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.222812 5751 ts_tablet_manager.cc:1403] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.013s
I20251215 20:54:25.223668 5754 ts_tablet_manager.cc:1434] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:54:25.224725 5754 tablet_bootstrap.cc:492] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.225437 5751 raft_consensus.cc:359] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.226171 5751 raft_consensus.cc:385] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.226490 5751 raft_consensus.cc:740] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.227186 5751 consensus_queue.cc:260] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.229753 5751 ts_tablet_manager.cc:1434] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251215 20:54:25.230708 5751 tablet_bootstrap.cc:492] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:25.231174 5754 tablet_bootstrap.cc:654] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.236773 5751 tablet_bootstrap.cc:654] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.242481 5754 tablet_bootstrap.cc:492] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.242961 5754 ts_tablet_manager.cc:1403] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.008s
I20251215 20:54:25.243152 5752 tablet_bootstrap.cc:492] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.243572 5752 ts_tablet_manager.cc:1403] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.042s user 0.020s sys 0.019s
I20251215 20:54:25.245453 5754 raft_consensus.cc:359] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.245849 5752 raft_consensus.cc:359] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.246155 5754 raft_consensus.cc:385] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.246423 5752 raft_consensus.cc:385] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.246475 5754 raft_consensus.cc:740] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.246651 5751 tablet_bootstrap.cc:492] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.246795 5752 raft_consensus.cc:740] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.247332 5751 ts_tablet_manager.cc:1403] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.008s
I20251215 20:54:25.247321 5754 consensus_queue.cc:260] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.247612 5752 consensus_queue.cc:260] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.249763 5754 ts_tablet_manager.cc:1434] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20251215 20:54:25.250201 5751 raft_consensus.cc:359] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.250674 5754 tablet_bootstrap.cc:492] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.250871 5751 raft_consensus.cc:385] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.251155 5751 raft_consensus.cc:740] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.251808 5752 ts_tablet_manager.cc:1434] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:54:25.251860 5751 consensus_queue.cc:260] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.252956 5752 tablet_bootstrap.cc:492] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.256459 5751 ts_tablet_manager.cc:1434] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20251215 20:54:25.256917 5754 tablet_bootstrap.cc:654] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.257383 5751 tablet_bootstrap.cc:492] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:25.259920 5752 tablet_bootstrap.cc:654] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.263904 5751 tablet_bootstrap.cc:654] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.265515 5759 raft_consensus.cc:493] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.266024 5759 raft_consensus.cc:515] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.272332 5759 leader_election.cc:290] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.289122 5752 tablet_bootstrap.cc:492] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.289544 5752 ts_tablet_manager.cc:1403] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.037s user 0.024s sys 0.008s
I20251215 20:54:25.291395 5754 tablet_bootstrap.cc:492] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.291409 5752 raft_consensus.cc:359] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.292213 5752 raft_consensus.cc:385] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.292542 5752 raft_consensus.cc:740] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.292078 5754 ts_tablet_manager.cc:1403] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.015s
I20251215 20:54:25.293321 5752 consensus_queue.cc:260] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.296628 5637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:25.297340 5637 raft_consensus.cc:2468] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:25.298043 5752 ts_tablet_manager.cc:1434] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20251215 20:54:25.298600 5526 leader_election.cc:304] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.299039 5752 tablet_bootstrap.cc:492] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.299482 5759 raft_consensus.cc:2804] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.298535 5754 raft_consensus.cc:359] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.300592 5754 raft_consensus.cc:385] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.300930 5754 raft_consensus.cc:740] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.302268 5751 tablet_bootstrap.cc:492] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.302083 5754 consensus_queue.cc:260] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.302848 5751 ts_tablet_manager.cc:1403] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.046s user 0.012s sys 0.020s
I20251215 20:54:25.305070 5752 tablet_bootstrap.cc:654] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.305675 5751 raft_consensus.cc:359] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.306439 5751 raft_consensus.cc:385] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.300436 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:25.306756 5751 raft_consensus.cc:740] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.307161 5711 raft_consensus.cc:2468] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:25.307575 5751 consensus_queue.cc:260] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.299856 5759 raft_consensus.cc:493] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.309252 5759 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.310873 5754 ts_tablet_manager.cc:1434] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.017s user 0.004s sys 0.001s
I20251215 20:54:25.314335 5754 tablet_bootstrap.cc:492] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.320392 5754 tablet_bootstrap.cc:654] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.320837 5759 raft_consensus.cc:515] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.323596 5637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:25.324147 5637 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.325024 5752 tablet_bootstrap.cc:492] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.325505 5752 ts_tablet_manager.cc:1403] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.009s
I20251215 20:54:25.325737 5751 ts_tablet_manager.cc:1434] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.022s user 0.015s sys 0.006s
I20251215 20:54:25.326716 5751 tablet_bootstrap.cc:492] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:25.328118 5752 raft_consensus.cc:359] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.328709 5754 tablet_bootstrap.cc:492] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.328863 5752 raft_consensus.cc:385] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.329245 5754 ts_tablet_manager.cc:1403] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20251215 20:54:25.329207 5752 raft_consensus.cc:740] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.330019 5752 consensus_queue.cc:260] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.332257 5752 ts_tablet_manager.cc:1434] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:54:25.331949 5754 raft_consensus.cc:359] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.332661 5754 raft_consensus.cc:385] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.332947 5754 raft_consensus.cc:740] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.333235 5752 tablet_bootstrap.cc:492] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.333704 5751 tablet_bootstrap.cc:654] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.333719 5754 consensus_queue.cc:260] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.337867 5754 ts_tablet_manager.cc:1434] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20251215 20:54:25.338794 5754 tablet_bootstrap.cc:492] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.339485 5752 tablet_bootstrap.cc:654] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.343017 5637 raft_consensus.cc:2468] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:25.344520 5754 tablet_bootstrap.cc:654] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.344316 5526 leader_election.cc:304] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.345420 5776 raft_consensus.cc:2804] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.350680 5752 tablet_bootstrap.cc:492] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.351135 5752 ts_tablet_manager.cc:1403] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.012s
I20251215 20:54:25.353672 5752 raft_consensus.cc:359] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.354271 5752 raft_consensus.cc:385] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.354529 5752 raft_consensus.cc:740] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.355150 5751 tablet_bootstrap.cc:492] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.355258 5752 consensus_queue.cc:260] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.355760 5751 ts_tablet_manager.cc:1403] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.004s
I20251215 20:54:25.358361 5751 raft_consensus.cc:359] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.358987 5751 raft_consensus.cc:385] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.359257 5751 raft_consensus.cc:740] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.359854 5751 consensus_queue.cc:260] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.362546 5752 ts_tablet_manager.cc:1434] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20251215 20:54:25.365247 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:25.365449 5752 tablet_bootstrap.cc:492] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:25.365782 5711 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.366334 5762 raft_consensus.cc:493] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.366839 5762 raft_consensus.cc:515] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.365480 5751 ts_tablet_manager.cc:1434] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.009s user 0.003s sys 0.003s
I20251215 20:54:25.370191 5751 tablet_bootstrap.cc:492] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:25.372963 5711 raft_consensus.cc:2468] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:25.373934 5762 leader_election.cc:290] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.374503 5759 leader_election.cc:290] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.379742 5776 raft_consensus.cc:697] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:25.380563 5751 tablet_bootstrap.cc:654] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.383158 5754 tablet_bootstrap.cc:492] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.385502 5754 ts_tablet_manager.cc:1403] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.047s user 0.033s sys 0.011s
I20251215 20:54:25.385124 5776 consensus_queue.cc:237] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.388283 5754 raft_consensus.cc:359] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.388991 5754 raft_consensus.cc:385] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.389302 5754 raft_consensus.cc:740] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.390012 5754 consensus_queue.cc:260] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.392431 5754 ts_tablet_manager.cc:1434] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251215 20:54:25.393283 5754 tablet_bootstrap.cc:492] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.383934 5752 tablet_bootstrap.cc:654] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.402623 5754 tablet_bootstrap.cc:654] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.407097 5752 tablet_bootstrap.cc:492] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:25.407547 5752 ts_tablet_manager.cc:1403] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.002s
I20251215 20:54:25.409982 5752 raft_consensus.cc:359] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.410604 5752 raft_consensus.cc:385] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.410866 5752 raft_consensus.cc:740] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.411533 5752 consensus_queue.cc:260] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.413691 5752 ts_tablet_manager.cc:1434] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:54:25.415514 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
W20251215 20:54:25.420724 5600 leader_election.cc:343] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:25.423949 5754 tablet_bootstrap.cc:492] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.424512 5754 ts_tablet_manager.cc:1403] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.031s user 0.012s sys 0.010s
I20251215 20:54:25.427073 5754 raft_consensus.cc:359] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.427726 5754 raft_consensus.cc:385] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.427989 5754 raft_consensus.cc:740] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.428638 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:25.428747 5754 consensus_queue.cc:260] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.429418 5711 raft_consensus.cc:2468] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:25.430907 5754 ts_tablet_manager.cc:1434] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:54:25.430804 5602 leader_election.cc:304] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52
I20251215 20:54:25.431818 5754 tablet_bootstrap.cc:492] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:25.431988 5762 raft_consensus.cc:2804] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.432394 5762 raft_consensus.cc:493] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.432704 5762 raft_consensus.cc:3060] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.436930 5751 tablet_bootstrap.cc:492] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.437494 5754 tablet_bootstrap.cc:654] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.437424 5751 ts_tablet_manager.cc:1403] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.067s user 0.017s sys 0.026s
I20251215 20:54:25.441797 5751 raft_consensus.cc:359] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.441932 5762 raft_consensus.cc:515] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.442528 5751 raft_consensus.cc:385] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.442822 5751 raft_consensus.cc:740] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.443569 5751 consensus_queue.cc:260] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.443156 5458 catalog_manager.cc:5654] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:25.444693 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:25.445258 5562 raft_consensus.cc:3060] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.445883 5751 ts_tablet_manager.cc:1434] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:54:25.446820 5751 tablet_bootstrap.cc:492] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:25.452620 5751 tablet_bootstrap.cc:654] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.455199 5562 raft_consensus.cc:2468] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:25.456766 5600 leader_election.cc:304] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
W20251215 20:54:25.460346 5508 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:54:25.461223 5762 leader_election.cc:290] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.461512 5792 raft_consensus.cc:493] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.462000 5762 raft_consensus.cc:2804] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.462635 5762 raft_consensus.cc:697] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:25.463095 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:25.464028 5756 raft_consensus.cc:493] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.463588 5762 consensus_queue.cc:237] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.463716 5711 raft_consensus.cc:3060] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.464515 5756 raft_consensus.cc:515] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.462028 5792 raft_consensus.cc:515] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.472968 5711 raft_consensus.cc:2468] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:25.473361 5756 leader_election.cc:290] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.477281 5754 tablet_bootstrap.cc:492] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:25.477807 5754 ts_tablet_manager.cc:1403] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.046s user 0.015s sys 0.014s
I20251215 20:54:25.481142 5792 leader_election.cc:290] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.482167 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:25.477334 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:25.483456 5562 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:25.484644 5600 leader_election.cc:304] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.483461 5711 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:25.485471 5754 raft_consensus.cc:359] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.486819 5754 raft_consensus.cc:385] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.487121 5754 raft_consensus.cc:740] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.487739 5754 consensus_queue.cc:260] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.485122 5457 catalog_manager.cc:5654] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 0 to 1, leader changed from <none> to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 1 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:25.488821 5756 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.489324 5756 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.486899 5792 raft_consensus.cc:2804] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.490703 5792 raft_consensus.cc:493] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.491055 5792 raft_consensus.cc:3060] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.491740 5756 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.493722 5754 ts_tablet_manager.cc:1434] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20251215 20:54:25.493939 5751 tablet_bootstrap.cc:492] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.494598 5751 ts_tablet_manager.cc:1403] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.048s user 0.011s sys 0.016s
I20251215 20:54:25.497455 5751 raft_consensus.cc:359] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.498044 5751 raft_consensus.cc:385] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.498313 5751 raft_consensus.cc:740] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.498912 5751 consensus_queue.cc:260] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.500849 5751 ts_tablet_manager.cc:1434] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20251215 20:54:25.501705 5751 tablet_bootstrap.cc:492] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:25.506639 5751 tablet_bootstrap.cc:654] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:25.506433 5792 raft_consensus.cc:515] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.509040 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:25.509620 5562 raft_consensus.cc:3060] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.516803 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:25.518329 5751 tablet_bootstrap.cc:492] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:25.518180 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:25.518780 5751 ts_tablet_manager.cc:1403] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.005s
I20251215 20:54:25.518903 5561 raft_consensus.cc:2468] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:25.521144 5751 raft_consensus.cc:359] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.521813 5751 raft_consensus.cc:385] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:25.522068 5751 raft_consensus.cc:740] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:25.522655 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:25.522792 5751 consensus_queue.cc:260] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.523242 5711 raft_consensus.cc:3060] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.524533 5791 raft_consensus.cc:493] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.525017 5751 ts_tablet_manager.cc:1434] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:54:25.525035 5791 raft_consensus.cc:515] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.527910 5791 leader_election.cc:290] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.528991 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:25.529654 5710 raft_consensus.cc:2468] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:25.529798 5711 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:25.530436 5792 leader_election.cc:290] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
W20251215 20:54:25.530463 5674 leader_election.cc:343] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:25.521091 5562 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:25.530797 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:25.531340 5674 leader_election.cc:304] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:25.531574 5561 raft_consensus.cc:2468] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:25.531898 5600 leader_election.cc:304] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.522119 5756 raft_consensus.cc:493] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.532725 5756 raft_consensus.cc:515] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.533429 5602 leader_election.cc:304] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.533448 5801 raft_consensus.cc:2804] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.534413 5801 raft_consensus.cc:493] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.534725 5801 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.534663 5756 leader_election.cc:290] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.535447 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:25.536012 5562 raft_consensus.cc:2468] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:25.536890 5776 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.537467 5792 raft_consensus.cc:2804] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.537340 5776 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.537935 5792 raft_consensus.cc:697] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:25.538729 5792 consensus_queue.cc:237] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.539170 5637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:25.539633 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:25.539800 5637 raft_consensus.cc:2468] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:25.539731 5674 leader_election.cc:304] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:25.540335 5636 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:25.540827 5756 raft_consensus.cc:2804] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.541169 5756 raft_consensus.cc:493] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.541534 5756 raft_consensus.cc:3060] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.541738 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:25.542459 5635 raft_consensus.cc:2468] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:25.544068 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:25.544683 5711 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:25.545627 5675 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52
I20251215 20:54:25.545996 5527 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:25.546537 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:25.546876 5759 raft_consensus.cc:2804] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.547478 5759 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.547837 5803 raft_consensus.cc:493] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.539165 5776 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.547801 5759 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.547166 5635 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:25.549310 5804 raft_consensus.cc:2804] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.549695 5804 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.549989 5804 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.553696 5803 raft_consensus.cc:515] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.553932 5801 raft_consensus.cc:515] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.555968 5801 leader_election.cc:290] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.548148 5791 raft_consensus.cc:2804] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.556715 5791 raft_consensus.cc:493] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.557078 5791 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.556340 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:25.557466 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:25.557744 5562 raft_consensus.cc:2468] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:25.558087 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:25.558039 5561 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.558876 5674 leader_election.cc:304] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:25.558971 5635 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.558912 5759 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.566555 5759 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.562785 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:25.563341 5801 raft_consensus.cc:2804] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.568625 5801 raft_consensus.cc:493] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.568274 5756 raft_consensus.cc:515] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.569031 5801 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.569355 5637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:25.569985 5637 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.571168 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:25.571820 5562 raft_consensus.cc:3060] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.577129 5637 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:25.577392 5561 raft_consensus.cc:2468] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:25.578220 5562 raft_consensus.cc:2468] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:25.578333 5526 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.578478 5674 leader_election.cc:304] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:25.579293 5776 raft_consensus.cc:2804] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.579787 5756 leader_election.cc:290] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.579807 5776 raft_consensus.cc:697] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:25.580358 5762 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.580555 5756 raft_consensus.cc:2804] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.566912 5804 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.567550 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:25.580821 5762 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.580932 5776 consensus_queue.cc:237] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.582093 5711 raft_consensus.cc:2393] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ac534568c51434db437a84eb004db52 in current term 1: Already voted for candidate ede15f5ea3a24a58a56e8caebd2dc41b in this term.
I20251215 20:54:25.582829 5762 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.583417 5756 raft_consensus.cc:697] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:25.561811 5803 leader_election.cc:290] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.571257 5636 raft_consensus.cc:2468] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:25.564666 5791 raft_consensus.cc:515] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.584489 5756 consensus_queue.cc:237] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.585825 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:25.585320 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:25.586422 5562 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:25.586840 5634 raft_consensus.cc:3060] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.587054 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:25.587437 5600 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.587626 5560 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.588614 5791 leader_election.cc:290] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.589190 5791 raft_consensus.cc:2804] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:25.589565 5791 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:25.589885 5791 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.590189 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:25.590970 5636 raft_consensus.cc:2393] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ede15f5ea3a24a58a56e8caebd2dc41b in current term 1: Already voted for candidate 9ac534568c51434db437a84eb004db52 in this term.
I20251215 20:54:25.589200 5804 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.595014 5560 raft_consensus.cc:2468] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:25.575984 5801 raft_consensus.cc:515] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.596052 5600 leader_election.cc:304] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.596897 5762 raft_consensus.cc:2804] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.598613 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:25.599188 5636 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.597613 5801 leader_election.cc:290] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.608731 5634 raft_consensus.cc:2468] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:25.609095 5762 raft_consensus.cc:697] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:25.608712 5791 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.609966 5675 leader_election.cc:304] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.610853 5801 raft_consensus.cc:2804] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.611340 5801 raft_consensus.cc:697] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:25.609964 5762 consensus_queue.cc:237] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.613951 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:25.613016 5801 consensus_queue.cc:237] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.614626 5560 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.622287 5791 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:25.624851 5560 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:25.626075 5600 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.627532 5791 raft_consensus.cc:2804] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.628785 5791 raft_consensus.cc:697] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:25.629703 5791 consensus_queue.cc:237] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.630995 5457 catalog_manager.cc:5654] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:25.633414 5636 raft_consensus.cc:2468] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:25.634543 5675 leader_election.cc:304] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:25.614467 5635 raft_consensus.cc:2468] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:25.635993 5804 raft_consensus.cc:2804] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:25.636574 5804 raft_consensus.cc:697] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:25.637552 5804 consensus_queue.cc:237] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.638643 5805 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:25.639129 5805 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:25.642082 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
W20251215 20:54:25.642431 5674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:37493, user_credentials={real_user=slave}} blocked reactor thread for 64022.9us
I20251215 20:54:25.646309 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:25.646822 5562 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.647114 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:25.648041 5561 raft_consensus.cc:2393] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ede15f5ea3a24a58a56e8caebd2dc41b in current term 1: Already voted for candidate f13926e3f3cd4a85998b5d16f2bc85ed in this term.
I20251215 20:54:25.649488 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:25.649519 5805 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:25.651386 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:25.652048 5711 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:25.655059 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:25.655575 5711 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.655514 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:25.656446 5710 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:25.660436 5562 raft_consensus.cc:2468] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:25.662672 5711 raft_consensus.cc:2468] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:25.664810 5674 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:25.665916 5710 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:25.666070 5674 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:25.666585 5805 raft_consensus.cc:2749] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:25.666127 5457 catalog_manager.cc:5654] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 0 to 1, leader changed from <none> to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 1 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:25.666996 5756 raft_consensus.cc:2749] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 20:54:25.669951 5458 catalog_manager.cc:5654] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 0 to 1, leader changed from <none> to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:25.681875 5458 catalog_manager.cc:5654] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 0 to 1, leader changed from <none> to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 1 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:25.683077 5458 catalog_manager.cc:5654] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 0 to 1, leader changed from <none> to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 1 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:25.683296 5457 catalog_manager.cc:5654] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 0 to 1, leader changed from <none> to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:25.684610 5457 catalog_manager.cc:5654] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 0 to 1, leader changed from <none> to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:25.789904 5776 consensus_queue.cc:1048] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:25.800382 5759 consensus_queue.cc:1048] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:25.818049 5710 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c13de8b1518d44739e99be20483c275b"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
mode: GRACEFUL
new_leader_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:59970
I20251215 20:54:25.818578 5710 raft_consensus.cc:606] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Received request to transfer leadership to TS 9ac534568c51434db437a84eb004db52
I20251215 20:54:25.823074 5710 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
mode: GRACEFUL
new_leader_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:59970
I20251215 20:54:25.823501 5710 raft_consensus.cc:606] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Received request to transfer leadership to TS 9ac534568c51434db437a84eb004db52
I20251215 20:54:25.833683 5635 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
mode: GRACEFUL
new_leader_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:35836
I20251215 20:54:25.834118 5635 raft_consensus.cc:606] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Received request to transfer leadership to TS 9ac534568c51434db437a84eb004db52
I20251215 20:54:25.838047 5710 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
mode: GRACEFUL
new_leader_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:59970
I20251215 20:54:25.838510 5710 raft_consensus.cc:606] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Received request to transfer leadership to TS 9ac534568c51434db437a84eb004db52
I20251215 20:54:25.848683 5562 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0"
dest_uuid: "9ac534568c51434db437a84eb004db52"
mode: GRACEFUL
new_leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:55588
I20251215 20:54:25.849130 5562 raft_consensus.cc:606] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Received request to transfer leadership to TS f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:25.857551 5562 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1"
dest_uuid: "9ac534568c51434db437a84eb004db52"
mode: GRACEFUL
new_leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:55588
I20251215 20:54:25.857961 5562 raft_consensus.cc:606] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Received request to transfer leadership to TS f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:25.861774 5635 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
mode: GRACEFUL
new_leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
from {username='slave'} at 127.0.0.1:35836
I20251215 20:54:25.862187 5635 raft_consensus.cc:606] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Received request to transfer leadership to TS ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:25.869311 5791 consensus_queue.cc:1048] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:25.878427 5792 consensus_queue.cc:1048] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.005265 5792 consensus_queue.cc:1048] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.014518 5762 consensus_queue.cc:1048] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.019428 5759 consensus_queue.cc:1048] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.030658 5780 consensus_queue.cc:1048] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.036903 5759 raft_consensus.cc:993] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52: : Instructing follower f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:26.037302 5780 raft_consensus.cc:1081] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Signalling peer f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:26.038657 5635 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:35818
I20251215 20:54:26.039100 5635 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:26.039382 5635 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.043709 5635 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.045069 5635 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:26.045883 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:26.046309 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:26.046450 5562 raft_consensus.cc:3055] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:26.046864 5562 raft_consensus.cc:740] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:26.046861 5711 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.047710 5562 consensus_queue.cc:260] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.048977 5562 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.052073 5711 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:26.052994 5602 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:26.053702 5762 raft_consensus.cc:2804] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:26.053869 5562 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:26.054056 5762 raft_consensus.cc:697] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:26.054893 5762 consensus_queue.cc:237] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.059566 5805 consensus_queue.cc:1048] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.061131 5458 catalog_manager.cc:5654] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 1 to 2, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 2 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:26.063758 5762 consensus_queue.cc:1048] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.074791 5801 consensus_queue.cc:1048] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.076265 5792 raft_consensus.cc:993] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed: : Instructing follower 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:26.076753 5792 raft_consensus.cc:1081] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Signalling peer 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:26.081668 5561 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001"
dest_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:55568
I20251215 20:54:26.082219 5561 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:26.082576 5561 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.083608 5762 consensus_queue.cc:1048] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.086115 5756 raft_consensus.cc:993] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b: : Instructing follower 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:26.086580 5756 raft_consensus.cc:1081] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Signalling peer 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:26.090246 5560 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f"
dest_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:55572
I20251215 20:54:26.090760 5560 raft_consensus.cc:493] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:26.091089 5560 raft_consensus.cc:3060] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.096122 5560 raft_consensus.cc:515] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.098446 5560 leader_election.cc:290] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:26.099925 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:26.100167 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:26.100600 5711 raft_consensus.cc:3055] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:26.100956 5711 raft_consensus.cc:740] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:26.097888 5561 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.101936 5562 raft_consensus.cc:1240] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Rejecting Update request from peer f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 1. Current term is 2. Ops: []
I20251215 20:54:26.102027 5711 consensus_queue.cc:260] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.103822 5561 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:26.104609 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:26.105067 5636 raft_consensus.cc:3055] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:26.105304 5636 raft_consensus.cc:740] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:26.105911 5636 consensus_queue.cc:260] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.106750 5762 consensus_queue.cc:1059] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.107770 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:26.107813 5636 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.108503 5710 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.100943 5635 raft_consensus.cc:3060] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.111683 5762 consensus_queue.cc:1048] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.107945 5711 raft_consensus.cc:3060] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.114666 5710 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:26.115813 5527 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:26.116649 5780 raft_consensus.cc:2804] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:26.116928 5636 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:26.117076 5780 raft_consensus.cc:697] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:26.117946 5780 consensus_queue.cc:237] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.121240 5711 raft_consensus.cc:2468] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:26.122241 5527 leader_election.cc:304] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:26.122608 5635 raft_consensus.cc:2468] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:26.122978 5780 raft_consensus.cc:2804] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:26.123648 5780 raft_consensus.cc:697] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:26.124471 5780 consensus_queue.cc:237] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.125181 5791 raft_consensus.cc:993] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed: : Instructing follower ede15f5ea3a24a58a56e8caebd2dc41b to start an election
I20251215 20:54:26.125613 5791 raft_consensus.cc:1081] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Signalling peer ede15f5ea3a24a58a56e8caebd2dc41b to start an election
I20251215 20:54:26.126291 5460 catalog_manager.cc:5654] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 1 to 2, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:26.130306 5792 consensus_queue.cc:1048] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.131202 5711 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
from {username='slave'} at 127.0.0.1:59966
I20251215 20:54:26.131789 5711 raft_consensus.cc:493] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:26.132222 5711 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.140071 5711 raft_consensus.cc:515] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.141048 5709 raft_consensus.cc:1240] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Rejecting Update request from peer f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 1. Current term is 2. Ops: []
I20251215 20:54:26.141983 5711 leader_election.cc:290] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:26.142669 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:26.143178 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:26.143730 5635 raft_consensus.cc:3055] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:26.144014 5635 raft_consensus.cc:740] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:26.144788 5635 consensus_queue.cc:260] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.145869 5635 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.146035 5457 catalog_manager.cc:5654] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 1 to 2, leader changed from ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:26.147595 5804 consensus_queue.cc:1048] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.152467 5635 raft_consensus.cc:2468] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:26.153437 5675 leader_election.cc:304] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52
I20251215 20:54:26.154788 5801 raft_consensus.cc:2804] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:26.155316 5801 raft_consensus.cc:697] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:26.156131 5801 consensus_queue.cc:237] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.164435 5832 consensus_queue.cc:1048] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.163874 5457 catalog_manager.cc:5654] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 1 to 2, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:26.165771 5832 consensus_queue.cc:1048] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.176929 5832 raft_consensus.cc:993] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b: : Instructing follower 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:26.177345 5801 raft_consensus.cc:1081] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Signalling peer 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:26.178846 5562 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d"
dest_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:55572
I20251215 20:54:26.181735 5562 raft_consensus.cc:493] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:26.182090 5562 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.182425 5804 consensus_queue.cc:1048] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:26.188191 5562 raft_consensus.cc:515] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.189940 5832 raft_consensus.cc:993] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b: : Instructing follower 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:26.190413 5805 raft_consensus.cc:1081] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Signalling peer 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:26.190809 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:26.191367 5636 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.192809 5561 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c13de8b1518d44739e99be20483c275b"
dest_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:55572
I20251215 20:54:26.193418 5561 raft_consensus.cc:493] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:26.193812 5561 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.197408 5562 leader_election.cc:290] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:26.197901 5636 raft_consensus.cc:2468] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:26.198390 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:26.198868 5526 leader_election.cc:304] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:26.198943 5711 raft_consensus.cc:3055] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:26.199362 5711 raft_consensus.cc:740] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:26.199472 5780 raft_consensus.cc:2804] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:26.199968 5780 raft_consensus.cc:697] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:26.200119 5711 consensus_queue.cc:260] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.201264 5711 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.200927 5780 consensus_queue.cc:237] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.206175 5561 raft_consensus.cc:515] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.207497 5711 raft_consensus.cc:2468] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:26.208639 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:26.210129 5636 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.210508 5776 raft_consensus.cc:993] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52: : Instructing follower f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:26.210888 5780 raft_consensus.cc:1081] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Signalling peer f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:26.214090 5635 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:35818
I20251215 20:54:26.214618 5635 raft_consensus.cc:493] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:26.214968 5635 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.215116 5636 raft_consensus.cc:2468] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:26.215994 5526 leader_election.cc:304] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:26.216791 5561 leader_election.cc:290] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:26.218076 5458 catalog_manager.cc:5654] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 1 to 2, leader changed from ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:26.219064 5780 raft_consensus.cc:2804] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:26.219548 5780 raft_consensus.cc:697] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:26.220037 5635 raft_consensus.cc:515] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.220330 5780 consensus_queue.cc:237] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.222926 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:26.223446 5709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:26.223531 5711 raft_consensus.cc:3055] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:26.223242 5635 leader_election.cc:290] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:26.224072 5711 raft_consensus.cc:740] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:26.224071 5709 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.225111 5711 consensus_queue.cc:260] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.226001 5711 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.223668 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:26.229045 5561 raft_consensus.cc:3055] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:26.229398 5561 raft_consensus.cc:740] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:26.230234 5561 consensus_queue.cc:260] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.231230 5709 raft_consensus.cc:2468] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:26.231494 5561 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.231689 5711 raft_consensus.cc:2468] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:26.232507 5602 leader_election.cc:304] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:26.233433 5792 raft_consensus.cc:2804] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:26.233883 5792 raft_consensus.cc:697] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:26.233970 5458 catalog_manager.cc:5654] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 1 to 2, leader changed from ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:26.234686 5792 consensus_queue.cc:237] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:26.236799 5561 raft_consensus.cc:2468] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:26.241080 5457 catalog_manager.cc:5654] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 1 to 2, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 2 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:26.454684 5561 raft_consensus.cc:1275] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.455744 5791 consensus_queue.cc:1048] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.464983 5709 raft_consensus.cc:1275] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.466388 5808 consensus_queue.cc:1048] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.567785 5711 raft_consensus.cc:1275] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.568840 5780 consensus_queue.cc:1048] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.575371 5635 raft_consensus.cc:1275] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.576872 5836 consensus_queue.cc:1048] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:54:26.621444 5635 raft_consensus.cc:1275] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.622495 5836 consensus_queue.cc:1048] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.626931 5711 raft_consensus.cc:1275] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.629388 5709 raft_consensus.cc:1275] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.630806 5710 raft_consensus.cc:1275] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.632277 5780 consensus_queue.cc:1048] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.632577 5836 consensus_queue.cc:1048] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.634895 5808 consensus_queue.cc:1048] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.648653 5561 raft_consensus.cc:1275] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.649032 5635 raft_consensus.cc:1275] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.649032 5711 raft_consensus.cc:1275] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.650187 5792 consensus_queue.cc:1048] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.650527 5776 consensus_queue.cc:1048] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.651746 5776 consensus_queue.cc:1048] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.664868 5635 raft_consensus.cc:1275] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.666123 5776 consensus_queue.cc:1048] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.760776 5561 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:26.765597 5561 raft_consensus.cc:1275] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.766657 5805 consensus_queue.cc:1048] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:26.773418 5635 raft_consensus.cc:1275] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:26.775071 5805 consensus_queue.cc:1048] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:28.863281 426 test_util.cc:276] Using random seed: -785214186
I20251215 20:54:28.887109 5457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35632:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 20:54:28.889155 5457 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 20:54:28.933905 5552 tablet_service.cc:1505] Processing CreateTablet for tablet 89c46b4c730d41b7b4ba730a23092be2 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:28.935050 5552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c46b4c730d41b7b4ba730a23092be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.934973 5624 tablet_service.cc:1505] Processing CreateTablet for tablet 89c46b4c730d41b7b4ba730a23092be2 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:28.936196 5624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c46b4c730d41b7b4ba730a23092be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.935947 5694 tablet_service.cc:1505] Processing CreateTablet for tablet 89c46b4c730d41b7b4ba730a23092be2 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20251215 20:54:28.937112 5694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c46b4c730d41b7b4ba730a23092be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.942245 5550 tablet_service.cc:1505] Processing CreateTablet for tablet 79da44dccd03456b9a38946441f0bc30 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:28.943432 5550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79da44dccd03456b9a38946441f0bc30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.944577 5620 tablet_service.cc:1505] Processing CreateTablet for tablet 79da44dccd03456b9a38946441f0bc30 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:28.944917 5695 tablet_service.cc:1505] Processing CreateTablet for tablet 79da44dccd03456b9a38946441f0bc30 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20251215 20:54:28.945772 5620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79da44dccd03456b9a38946441f0bc30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.946048 5695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79da44dccd03456b9a38946441f0bc30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.943558 5546 tablet_service.cc:1505] Processing CreateTablet for tablet 6705aa242e244c4ca9502545a1a8465a (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:28.949182 5545 tablet_service.cc:1505] Processing CreateTablet for tablet b80e077e39454d528d3529f61a99d59f (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:28.951622 5547 tablet_service.cc:1505] Processing CreateTablet for tablet 4c4ee2039d89423297fedad862ed6c83 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:28.952402 5622 tablet_service.cc:1505] Processing CreateTablet for tablet 6705aa242e244c4ca9502545a1a8465a (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:28.953536 5549 tablet_service.cc:1505] Processing CreateTablet for tablet 994f1a59a8c54245bfbd9100395e6a41 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:28.954401 5698 tablet_service.cc:1505] Processing CreateTablet for tablet 6705aa242e244c4ca9502545a1a8465a (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20251215 20:54:28.955606 5698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6705aa242e244c4ca9502545a1a8465a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.955330 5619 tablet_service.cc:1505] Processing CreateTablet for tablet 994f1a59a8c54245bfbd9100395e6a41 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:28.955427 5625 tablet_service.cc:1505] Processing CreateTablet for tablet b80e077e39454d528d3529f61a99d59f (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:28.954432 5621 tablet_service.cc:1505] Processing CreateTablet for tablet 4c4ee2039d89423297fedad862ed6c83 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:28.957180 5699 tablet_service.cc:1505] Processing CreateTablet for tablet 994f1a59a8c54245bfbd9100395e6a41 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20251215 20:54:28.958359 5699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994f1a59a8c54245bfbd9100395e6a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.959546 5626 tablet_service.cc:1505] Processing CreateTablet for tablet 339ca3e921e1499883173b6f68571fce (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:28.959586 5623 tablet_service.cc:1505] Processing CreateTablet for tablet 73a5617219cb4d54a353faa8c01e1d00 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:28.961354 5700 tablet_service.cc:1505] Processing CreateTablet for tablet 4c4ee2039d89423297fedad862ed6c83 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20251215 20:54:28.962092 5697 tablet_service.cc:1505] Processing CreateTablet for tablet 73a5617219cb4d54a353faa8c01e1d00 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:28.962524 5700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4ee2039d89423297fedad862ed6c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.962760 5696 tablet_service.cc:1505] Processing CreateTablet for tablet 339ca3e921e1499883173b6f68571fce (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:28.949209 5701 tablet_service.cc:1505] Processing CreateTablet for tablet b80e077e39454d528d3529f61a99d59f (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20251215 20:54:28.964424 5693 tablet_service.cc:1505] Processing CreateTablet for tablet 43a1d5d92b924a2abdb9b294d761286c (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:28.965814 5548 tablet_service.cc:1505] Processing CreateTablet for tablet 73a5617219cb4d54a353faa8c01e1d00 (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20251215 20:54:28.953562 5622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6705aa242e244c4ca9502545a1a8465a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.966157 5551 tablet_service.cc:1505] Processing CreateTablet for tablet 339ca3e921e1499883173b6f68571fce (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20251215 20:54:28.949288 5546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6705aa242e244c4ca9502545a1a8465a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.967240 5619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994f1a59a8c54245bfbd9100395e6a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.968044 5626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339ca3e921e1499883173b6f68571fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.966486 5544 tablet_service.cc:1505] Processing CreateTablet for tablet 43a1d5d92b924a2abdb9b294d761286c (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:28.968688 5621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4ee2039d89423297fedad862ed6c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.969779 5627 tablet_service.cc:1505] Processing CreateTablet for tablet 43a1d5d92b924a2abdb9b294d761286c (DEFAULT_TABLE table=soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20251215 20:54:28.963274 5697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a5617219cb4d54a353faa8c01e1d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.970878 5623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a5617219cb4d54a353faa8c01e1d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.971908 5696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339ca3e921e1499883173b6f68571fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.973542 5627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a1d5d92b924a2abdb9b294d761286c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.975131 5625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80e077e39454d528d3529f61a99d59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.975847 5693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a1d5d92b924a2abdb9b294d761286c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.976652 5701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80e077e39454d528d3529f61a99d59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.967348 5551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339ca3e921e1499883173b6f68571fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.980744 5548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a5617219cb4d54a353faa8c01e1d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.982811 5544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a1d5d92b924a2abdb9b294d761286c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.984572 5549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994f1a59a8c54245bfbd9100395e6a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:28.999974 5547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4ee2039d89423297fedad862ed6c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:29.000648 5545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80e077e39454d528d3529f61a99d59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 20:54:29.060959 5848 tablet_bootstrap.cc:492] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.070576 5849 tablet_bootstrap.cc:492] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:29.076152 5849 tablet_bootstrap.cc:654] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.077560 5848 tablet_bootstrap.cc:654] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.084860 5847 tablet_bootstrap.cc:492] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.095103 5847 tablet_bootstrap.cc:654] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.108613 5849 tablet_bootstrap.cc:492] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.109251 5849 ts_tablet_manager.cc:1403] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.009s
I20251215 20:54:29.111778 5849 raft_consensus.cc:359] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.112473 5849 raft_consensus.cc:385] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.112778 5849 raft_consensus.cc:740] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.114105 5847 tablet_bootstrap.cc:492] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.114043 5849 consensus_queue.cc:260] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.114583 5847 ts_tablet_manager.cc:1403] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.008s
I20251215 20:54:29.115088 5848 tablet_bootstrap.cc:492] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.115549 5848 ts_tablet_manager.cc:1403] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.005s
I20251215 20:54:29.116192 5849 ts_tablet_manager.cc:1434] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
I20251215 20:54:29.117215 5849 tablet_bootstrap.cc:492] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:29.117317 5847 raft_consensus.cc:359] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.118037 5847 raft_consensus.cc:385] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.118304 5847 raft_consensus.cc:740] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.118304 5848 raft_consensus.cc:359] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.119210 5848 raft_consensus.cc:385] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.119030 5847 consensus_queue.cc:260] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.119490 5848 raft_consensus.cc:740] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.120121 5848 consensus_queue.cc:260] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.121378 5847 ts_tablet_manager.cc:1434] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251215 20:54:29.122357 5847 tablet_bootstrap.cc:492] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.126199 5849 tablet_bootstrap.cc:654] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.128017 5847 tablet_bootstrap.cc:654] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.130731 5849 tablet_bootstrap.cc:492] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.131146 5849 ts_tablet_manager.cc:1403] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.001s
I20251215 20:54:29.134964 5849 raft_consensus.cc:359] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.135373 5848 ts_tablet_manager.cc:1434] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.020s user 0.007s sys 0.002s
I20251215 20:54:29.135648 5849 raft_consensus.cc:385] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.135974 5849 raft_consensus.cc:740] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.136643 5849 consensus_queue.cc:260] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.138865 5849 ts_tablet_manager.cc:1434] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20251215 20:54:29.139683 5849 tablet_bootstrap.cc:492] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:29.143940 5848 tablet_bootstrap.cc:492] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.145750 5849 tablet_bootstrap.cc:654] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.147716 5847 tablet_bootstrap.cc:492] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.148216 5847 ts_tablet_manager.cc:1403] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.013s
I20251215 20:54:29.150477 5848 tablet_bootstrap.cc:654] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.150987 5847 raft_consensus.cc:359] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.151674 5847 raft_consensus.cc:385] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.151945 5847 raft_consensus.cc:740] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.152616 5847 consensus_queue.cc:260] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.155006 5847 ts_tablet_manager.cc:1434] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20251215 20:54:29.155900 5847 tablet_bootstrap.cc:492] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.157032 5849 tablet_bootstrap.cc:492] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.157290 5848 tablet_bootstrap.cc:492] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.157512 5849 ts_tablet_manager.cc:1403] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.003s
I20251215 20:54:29.157759 5848 ts_tablet_manager.cc:1403] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.004s
I20251215 20:54:29.160230 5849 raft_consensus.cc:359] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.160987 5849 raft_consensus.cc:385] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.161293 5849 raft_consensus.cc:740] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.161653 5847 tablet_bootstrap.cc:654] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.161252 5848 raft_consensus.cc:359] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.162156 5848 raft_consensus.cc:385] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.162508 5848 raft_consensus.cc:740] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.162310 5849 consensus_queue.cc:260] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.164852 5849 ts_tablet_manager.cc:1434] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251215 20:54:29.165828 5849 tablet_bootstrap.cc:492] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:29.163272 5848 consensus_queue.cc:260] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.168941 5848 ts_tablet_manager.cc:1434] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.011s user 0.002s sys 0.005s
I20251215 20:54:29.169940 5848 tablet_bootstrap.cc:492] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.171603 5849 tablet_bootstrap.cc:654] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.178406 5848 tablet_bootstrap.cc:654] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.182281 5805 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.182822 5805 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.184813 5805 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:29.187134 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:29.190074 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.193112 5849 tablet_bootstrap.cc:492] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.193683 5849 ts_tablet_manager.cc:1403] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.007s
I20251215 20:54:29.196628 5849 raft_consensus.cc:359] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.197325 5849 raft_consensus.cc:385] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.197629 5849 raft_consensus.cc:740] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.198321 5849 consensus_queue.cc:260] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.200827 5849 ts_tablet_manager.cc:1434] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20251215 20:54:29.201797 5849 tablet_bootstrap.cc:492] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
W20251215 20:54:29.193312 5675 leader_election.cc:343] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951): Illegal state: must be running to vote when last-logged opid is not known
W20251215 20:54:29.204053 5674 leader_election.cc:343] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.206995 5808 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.207516 5808 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.207931 5849 tablet_bootstrap.cc:654] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.206313 5674 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:29.213349 5808 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.215447 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:29.216157 5561 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:29.217382 5600 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.218211 5805 raft_consensus.cc:2749] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:29.220484 5776 raft_consensus.cc:493] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.221014 5776 raft_consensus.cc:515] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.224479 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89c46b4c730d41b7b4ba730a23092be2" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:29.225132 5710 raft_consensus.cc:2468] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.226389 5527 leader_election.cc:304] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:29.227543 5776 leader_election.cc:290] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.228945 5776 raft_consensus.cc:2804] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.229301 5776 raft_consensus.cc:493] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.229647 5776 raft_consensus.cc:3060] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.238297 5849 tablet_bootstrap.cc:492] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.238883 5849 ts_tablet_manager.cc:1403] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.013s
I20251215 20:54:29.247085 5861 raft_consensus.cc:2804] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.247509 5861 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.247877 5861 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.249800 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:29.251585 5776 raft_consensus.cc:515] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.254132 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89c46b4c730d41b7b4ba730a23092be2" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.254456 5861 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.254793 5635 raft_consensus.cc:2468] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.247575 5847 tablet_bootstrap.cc:492] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.255682 5847 ts_tablet_manager.cc:1403] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.100s user 0.023s sys 0.068s
W20251215 20:54:29.256417 5602 leader_election.cc:343] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.257799 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89c46b4c730d41b7b4ba730a23092be2" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:29.258292 5635 raft_consensus.cc:3060] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.262954 5849 raft_consensus.cc:359] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.263360 5635 raft_consensus.cc:2468] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.263724 5849 raft_consensus.cc:385] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.264065 5849 raft_consensus.cc:740] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.264516 5526 leader_election.cc:304] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.265178 5849 consensus_queue.cc:260] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.265249 5862 raft_consensus.cc:2804] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.266320 5862 raft_consensus.cc:697] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:29.267083 5862 consensus_queue.cc:237] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.268180 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89c46b4c730d41b7b4ba730a23092be2" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:29.268821 5710 raft_consensus.cc:3060] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.270555 5847 raft_consensus.cc:359] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.271338 5847 raft_consensus.cc:385] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.271618 5847 raft_consensus.cc:740] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.273439 5847 consensus_queue.cc:260] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.275810 5847 ts_tablet_manager.cc:1434] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.020s user 0.000s sys 0.004s
I20251215 20:54:29.276842 5776 leader_election.cc:290] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.280995 5849 ts_tablet_manager.cc:1434] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.042s user 0.007s sys 0.003s
I20251215 20:54:29.275709 5710 raft_consensus.cc:2468] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.284119 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:29.284680 5847 tablet_bootstrap.cc:492] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.284575 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:29.285316 5561 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:54:29.285609 5602 leader_election.cc:343] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.287467 5457 catalog_manager.cc:5654] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:29.291374 5561 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:29.279574 5861 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.292945 5600 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:29.293908 5848 tablet_bootstrap.cc:492] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.294045 5861 raft_consensus.cc:2804] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.294400 5848 ts_tablet_manager.cc:1403] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.125s user 0.033s sys 0.055s
I20251215 20:54:29.294569 5861 raft_consensus.cc:697] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:29.281988 5849 tablet_bootstrap.cc:492] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:29.299281 5848 raft_consensus.cc:359] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.300086 5848 raft_consensus.cc:385] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.300953 5848 raft_consensus.cc:740] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.301000 5861 consensus_queue.cc:237] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.302002 5847 tablet_bootstrap.cc:654] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.301698 5848 consensus_queue.cc:260] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.302973 5849 tablet_bootstrap.cc:654] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.305130 5848 ts_tablet_manager.cc:1434] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20251215 20:54:29.306092 5848 tablet_bootstrap.cc:492] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.311795 5848 tablet_bootstrap.cc:654] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.315200 5849 tablet_bootstrap.cc:492] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.315557 5849 ts_tablet_manager.cc:1403] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.034s user 0.016s sys 0.000s
I20251215 20:54:29.317850 5849 raft_consensus.cc:359] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.318504 5849 raft_consensus.cc:385] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.318802 5849 raft_consensus.cc:740] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.319559 5849 consensus_queue.cc:260] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.322079 5849 ts_tablet_manager.cc:1434] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20251215 20:54:29.323197 5848 tablet_bootstrap.cc:492] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.319967 5457 catalog_manager.cc:5654] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 0 to 1, leader changed from <none> to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 1 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:29.323794 5848 ts_tablet_manager.cc:1403] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.004s
I20251215 20:54:29.326484 5848 raft_consensus.cc:359] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.327239 5849 tablet_bootstrap.cc:492] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:29.327241 5848 raft_consensus.cc:385] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.327858 5848 raft_consensus.cc:740] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.328598 5848 consensus_queue.cc:260] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.330924 5848 ts_tablet_manager.cc:1434] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:54:29.331883 5848 tablet_bootstrap.cc:492] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.337587 5848 tablet_bootstrap.cc:654] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.345674 5847 tablet_bootstrap.cc:492] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.346041 5847 ts_tablet_manager.cc:1403] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.064s user 0.023s sys 0.011s
I20251215 20:54:29.346689 5848 tablet_bootstrap.cc:492] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.347190 5848 ts_tablet_manager.cc:1403] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.002s
I20251215 20:54:29.348382 5847 raft_consensus.cc:359] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.350073 5847 raft_consensus.cc:385] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.349731 5848 raft_consensus.cc:359] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.350368 5847 raft_consensus.cc:740] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.350474 5848 raft_consensus.cc:385] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.350838 5848 raft_consensus.cc:740] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.351176 5847 consensus_queue.cc:260] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.351830 5849 tablet_bootstrap.cc:654] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.351475 5848 consensus_queue.cc:260] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.353830 5848 ts_tablet_manager.cc:1434] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251215 20:54:29.355644 5847 ts_tablet_manager.cc:1434] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.009s user 0.003s sys 0.003s
I20251215 20:54:29.356685 5847 tablet_bootstrap.cc:492] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.362900 5865 raft_consensus.cc:493] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.363361 5865 raft_consensus.cc:515] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.365293 5865 leader_election.cc:290] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.366340 5848 tablet_bootstrap.cc:492] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.366705 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.367338 5635 raft_consensus.cc:2468] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.368669 5526 leader_election.cc:304] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.369233 5865 raft_consensus.cc:2804] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.369590 5865 raft_consensus.cc:493] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.369904 5865 raft_consensus.cc:3060] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.371078 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:29.371680 5711 raft_consensus.cc:2468] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.372099 5847 tablet_bootstrap.cc:654] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.373080 5848 tablet_bootstrap.cc:654] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.374722 5805 raft_consensus.cc:493] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.375245 5805 raft_consensus.cc:515] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.378055 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
W20251215 20:54:29.379392 5674 leader_election.cc:343] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.381843 5861 raft_consensus.cc:493] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.382459 5861 raft_consensus.cc:515] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.386222 5861 leader_election.cc:290] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.386472 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "994f1a59a8c54245bfbd9100395e6a41" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:29.386992 5561 raft_consensus.cc:2468] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 0.
I20251215 20:54:29.388090 5600 leader_election.cc:304] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.388723 5848 tablet_bootstrap.cc:492] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.388917 5861 raft_consensus.cc:2804] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.389202 5848 ts_tablet_manager.cc:1403] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.002s
I20251215 20:54:29.389300 5861 raft_consensus.cc:493] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.389778 5861 raft_consensus.cc:3060] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.389734 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "994f1a59a8c54245bfbd9100395e6a41" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:29.390497 5805 leader_election.cc:290] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:29.391193 5849 tablet_bootstrap.cc:492] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.391680 5849 ts_tablet_manager.cc:1403] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.069s user 0.014s sys 0.018s
I20251215 20:54:29.391968 5848 raft_consensus.cc:359] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.392674 5848 raft_consensus.cc:385] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.392620 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.392879 5865 raft_consensus.cc:515] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.393061 5848 raft_consensus.cc:740] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.394162 5849 raft_consensus.cc:359] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
W20251215 20:54:29.394620 5675 leader_election.cc:343] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.394289 5848 consensus_queue.cc:260] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.394939 5849 raft_consensus.cc:385] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.395247 5849 raft_consensus.cc:740] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.396137 5675 leader_election.cc:304] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
W20251215 20:54:29.393010 5602 leader_election.cc:343] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.396409 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:29.396775 5848 ts_tablet_manager.cc:1434] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20251215 20:54:29.395900 5849 consensus_queue.cc:260] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.397892 5848 tablet_bootstrap.cc:492] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.398169 5711 raft_consensus.cc:3060] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.399013 5849 ts_tablet_manager.cc:1434] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20251215 20:54:29.399933 5849 tablet_bootstrap.cc:492] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:29.400607 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:29.401144 5635 raft_consensus.cc:3060] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.404564 5848 tablet_bootstrap.cc:654] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.407208 5849 tablet_bootstrap.cc:654] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.411617 5805 raft_consensus.cc:2749] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:29.413530 5865 leader_election.cc:290] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.415724 5635 raft_consensus.cc:2468] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.416839 5526 leader_election.cc:304] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.418210 5711 raft_consensus.cc:2468] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.419919 5848 tablet_bootstrap.cc:492] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.420187 5847 tablet_bootstrap.cc:492] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.420395 5848 ts_tablet_manager.cc:1403] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.011s
I20251215 20:54:29.420678 5847 ts_tablet_manager.cc:1403] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.009s
I20251215 20:54:29.422976 5865 raft_consensus.cc:2804] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.423177 5848 raft_consensus.cc:359] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.423463 5847 raft_consensus.cc:359] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.423938 5848 raft_consensus.cc:385] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.424269 5848 raft_consensus.cc:740] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.424307 5865 raft_consensus.cc:697] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:29.425140 5849 tablet_bootstrap.cc:492] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.425164 5848 consensus_queue.cc:260] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.425818 5849 ts_tablet_manager.cc:1403] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.026s user 0.015s sys 0.000s
I20251215 20:54:29.425707 5861 raft_consensus.cc:515] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.425807 5865 consensus_queue.cc:237] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.427524 5848 ts_tablet_manager.cc:1434] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.007s user 0.001s sys 0.003s
I20251215 20:54:29.428494 5848 tablet_bootstrap.cc:492] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.428917 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "994f1a59a8c54245bfbd9100395e6a41" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:29.428794 5849 raft_consensus.cc:359] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.429561 5561 raft_consensus.cc:3060] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.429581 5849 raft_consensus.cc:385] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.430145 5849 raft_consensus.cc:740] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.430783 5849 consensus_queue.cc:260] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.433064 5849 ts_tablet_manager.cc:1434] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20251215 20:54:29.433903 5849 tablet_bootstrap.cc:492] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b: Bootstrap starting.
I20251215 20:54:29.434669 5848 tablet_bootstrap.cc:654] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.436465 5561 raft_consensus.cc:2468] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:29.437480 5600 leader_election.cc:304] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.438268 5867 raft_consensus.cc:2804] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.438742 5867 raft_consensus.cc:697] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:29.439499 5867 consensus_queue.cc:237] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.446410 5849 tablet_bootstrap.cc:654] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.450186 5848 tablet_bootstrap.cc:492] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.450651 5848 ts_tablet_manager.cc:1403] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.008s
I20251215 20:54:29.452574 5460 catalog_manager.cc:5654] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:29.453140 5848 raft_consensus.cc:359] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.453929 5848 raft_consensus.cc:385] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.454206 5848 raft_consensus.cc:740] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.454861 5848 consensus_queue.cc:260] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.455442 5805 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.455830 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "994f1a59a8c54245bfbd9100395e6a41" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:29.455926 5805 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.457046 5848 ts_tablet_manager.cc:1434] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20251215 20:54:29.457825 5805 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:29.458027 5848 tablet_bootstrap.cc:492] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52: Bootstrap starting.
I20251215 20:54:29.460845 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:29.461599 5562 raft_consensus.cc:2393] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ede15f5ea3a24a58a56e8caebd2dc41b in current term 1: Already voted for candidate f13926e3f3cd4a85998b5d16f2bc85ed in this term.
I20251215 20:54:29.464215 5848 tablet_bootstrap.cc:654] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52: Neither blocks nor log segments found. Creating new log.
W20251215 20:54:29.457176 5602 leader_election.cc:343] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.455142 5861 leader_election.cc:290] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.424173 5847 raft_consensus.cc:385] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.474646 5847 raft_consensus.cc:740] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.475386 5847 consensus_queue.cc:260] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.483650 5847 ts_tablet_manager.cc:1434] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.063s user 0.006s sys 0.000s
W20251215 20:54:29.484669 5675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:34951, user_credentials={real_user=slave}} blocked reactor thread for 90070.7us
I20251215 20:54:29.484134 5460 catalog_manager.cc:5654] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 0 to 1, leader changed from <none> to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 1 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:29.486156 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.487226 5876 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.487607 5675 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:29.487757 5876 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.488391 5805 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.490742 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:29.491376 5561 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:29.492430 5674 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:29.495072 5805 raft_consensus.cc:2749] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:29.495796 5805 raft_consensus.cc:2804] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.496109 5805 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.496428 5805 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
W20251215 20:54:29.500451 5508 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20251215 20:54:29.500952 5847 tablet_bootstrap.cc:492] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.503446 5876 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:29.504398 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.506281 5849 tablet_bootstrap.cc:492] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b: No bootstrap required, opened a new log
I20251215 20:54:29.507061 5849 ts_tablet_manager.cc:1403] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent bootstrapping tablet: real 0.073s user 0.026s sys 0.032s
W20251215 20:54:29.508327 5675 leader_election.cc:343] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.510598 5849 raft_consensus.cc:359] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.510638 5805 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.511452 5849 raft_consensus.cc:385] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.511770 5849 raft_consensus.cc:740] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.512315 5849 consensus_queue.cc:260] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.512876 5805 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:29.513514 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:29.513535 5847 tablet_bootstrap.cc:654] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.514083 5561 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.514326 5849 ts_tablet_manager.cc:1434] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251215 20:54:29.514384 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:29.515260 5848 tablet_bootstrap.cc:492] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52: No bootstrap required, opened a new log
I20251215 20:54:29.515704 5848 ts_tablet_manager.cc:1403] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52: Time spent bootstrapping tablet: real 0.058s user 0.024s sys 0.010s
W20251215 20:54:29.515764 5675 leader_election.cc:343] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951): Illegal state: must be running to vote when last-logged opid is not known
I20251215 20:54:29.517680 5848 raft_consensus.cc:359] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.518183 5848 raft_consensus.cc:385] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.518373 5848 raft_consensus.cc:740] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.518972 5848 consensus_queue.cc:260] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.521665 5848 ts_tablet_manager.cc:1434] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20251215 20:54:29.523598 5561 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:29.524963 5674 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:29.525683 5805 raft_consensus.cc:2804] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.526191 5805 raft_consensus.cc:697] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:29.527058 5805 consensus_queue.cc:237] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.529029 5847 tablet_bootstrap.cc:492] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.529506 5847 ts_tablet_manager.cc:1403] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.001s
I20251215 20:54:29.531809 5847 raft_consensus.cc:359] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.532490 5847 raft_consensus.cc:385] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.532768 5847 raft_consensus.cc:740] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.533394 5847 consensus_queue.cc:260] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.535431 5847 ts_tablet_manager.cc:1434] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 20:54:29.536438 5847 tablet_bootstrap.cc:492] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.535974 5460 catalog_manager.cc:5654] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 0 to 1, leader changed from <none> to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:29.541935 5847 tablet_bootstrap.cc:654] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.548204 5847 tablet_bootstrap.cc:492] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.548563 5847 ts_tablet_manager.cc:1403] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20251215 20:54:29.550539 5847 raft_consensus.cc:359] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.551012 5847 raft_consensus.cc:385] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.551218 5847 raft_consensus.cc:740] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.551684 5847 consensus_queue.cc:260] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.553279 5847 ts_tablet_manager.cc:1434] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251215 20:54:29.553577 5805 raft_consensus.cc:493] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.554011 5847 tablet_bootstrap.cc:492] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.554062 5805 raft_consensus.cc:515] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.556044 5805 leader_election.cc:290] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:29.556826 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "994f1a59a8c54245bfbd9100395e6a41" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:29.557492 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "994f1a59a8c54245bfbd9100395e6a41" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.557598 5561 raft_consensus.cc:2393] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ede15f5ea3a24a58a56e8caebd2dc41b in current term 1: Already voted for candidate f13926e3f3cd4a85998b5d16f2bc85ed in this term.
I20251215 20:54:29.559012 5675 leader_election.cc:304] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:29.559722 5805 raft_consensus.cc:3060] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.560881 5847 tablet_bootstrap.cc:654] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.565363 5847 tablet_bootstrap.cc:492] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.565778 5847 ts_tablet_manager.cc:1403] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20251215 20:54:29.566212 5805 raft_consensus.cc:2749] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 20:54:29.567682 5847 raft_consensus.cc:359] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.568146 5847 raft_consensus.cc:385] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.568336 5847 raft_consensus.cc:740] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.568760 5847 consensus_queue.cc:260] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.570111 5847 ts_tablet_manager.cc:1434] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20251215 20:54:29.570932 5847 tablet_bootstrap.cc:492] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed: Bootstrap starting.
I20251215 20:54:29.575114 5847 tablet_bootstrap.cc:654] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed: Neither blocks nor log segments found. Creating new log.
I20251215 20:54:29.578881 5847 tablet_bootstrap.cc:492] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed: No bootstrap required, opened a new log
I20251215 20:54:29.579197 5847 ts_tablet_manager.cc:1403] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20251215 20:54:29.580843 5847 raft_consensus.cc:359] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.581274 5847 raft_consensus.cc:385] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 20:54:29.581454 5847 raft_consensus.cc:740] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Initialized, Role: FOLLOWER
I20251215 20:54:29.581943 5847 consensus_queue.cc:260] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.583673 5847 ts_tablet_manager.cc:1434] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 20:54:29.645660 5865 raft_consensus.cc:493] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.646214 5865 raft_consensus.cc:515] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.647899 5865 leader_election.cc:290] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.648535 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6705aa242e244c4ca9502545a1a8465a" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.648782 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6705aa242e244c4ca9502545a1a8465a" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:29.649098 5635 raft_consensus.cc:2468] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.649397 5711 raft_consensus.cc:2468] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.649968 5526 leader_election.cc:304] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.650671 5865 raft_consensus.cc:2804] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.650939 5865 raft_consensus.cc:493] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.651173 5865 raft_consensus.cc:3060] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.655567 5865 raft_consensus.cc:515] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.656978 5865 leader_election.cc:290] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.657635 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6705aa242e244c4ca9502545a1a8465a" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:29.657747 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6705aa242e244c4ca9502545a1a8465a" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:29.658092 5635 raft_consensus.cc:3060] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.658208 5711 raft_consensus.cc:3060] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.662514 5635 raft_consensus.cc:2468] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.662582 5711 raft_consensus.cc:2468] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.663350 5526 leader_election.cc:304] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.663921 5865 raft_consensus.cc:2804] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.664260 5865 raft_consensus.cc:697] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:29.664918 5865 consensus_queue.cc:237] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.676609 5460 catalog_manager.cc:5654] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:29.687801 5865 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.688308 5865 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.689914 5865 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.690497 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.690850 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:29.690997 5635 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.691414 5711 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.692121 5526 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.692878 5865 raft_consensus.cc:2804] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.693207 5865 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.693463 5865 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.698443 5865 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.699919 5865 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.700505 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:29.701025 5635 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.701058 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:29.701680 5711 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.707257 5635 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.708235 5526 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.708320 5711 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.709131 5865 raft_consensus.cc:2804] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.709570 5865 raft_consensus.cc:697] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:29.710242 5865 consensus_queue.cc:237] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.716199 5460 catalog_manager.cc:5654] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:29.812101 5863 consensus_queue.cc:1048] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:29.821913 5895 consensus_queue.cc:1048] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:29.843672 5805 raft_consensus.cc:493] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.844149 5805 raft_consensus.cc:515] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.845834 5805 leader_election.cc:290] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:29.846506 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:29.847028 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.847110 5561 raft_consensus.cc:2468] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:29.847738 5635 raft_consensus.cc:2468] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 0.
I20251215 20:54:29.848165 5674 leader_election.cc:304] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:29.848927 5805 raft_consensus.cc:2804] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.849263 5805 raft_consensus.cc:493] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.849524 5805 raft_consensus.cc:3060] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.853972 5805 raft_consensus.cc:515] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.855369 5805 leader_election.cc:290] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:29.855911 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:29.856376 5561 raft_consensus.cc:3060] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.856544 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:29.857019 5635 raft_consensus.cc:3060] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.860805 5561 raft_consensus.cc:2468] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:29.860965 5635 raft_consensus.cc:2468] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:29.861855 5674 leader_election.cc:304] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:29.862540 5805 raft_consensus.cc:2804] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.862989 5805 raft_consensus.cc:697] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:29.863678 5805 consensus_queue.cc:237] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.869488 5895 consensus_queue.cc:1048] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:29.870786 5458 catalog_manager.cc:5654] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 0 to 1, leader changed from <none> to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:29.876542 5865 raft_consensus.cc:493] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:29.877080 5865 raft_consensus.cc:515] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.878871 5865 leader_election.cc:290] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.882208 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:29.882867 5710 raft_consensus.cc:2468] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.884033 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:29.884392 5527 leader_election.cc:304] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:29.884279 5895 consensus_queue.cc:1048] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 20:54:29.884666 5635 raft_consensus.cc:2468] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 0.
I20251215 20:54:29.885234 5865 raft_consensus.cc:2804] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 20:54:29.885696 5865 raft_consensus.cc:493] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:29.886039 5865 raft_consensus.cc:3060] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.887358 5867 consensus_queue.cc:1048] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:29.893838 5867 consensus_queue.cc:1048] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:29.896250 5808 consensus_queue.cc:1048] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:29.893141 5865 raft_consensus.cc:515] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.899132 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:29.899628 5711 raft_consensus.cc:3060] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.899873 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:29.900398 5635 raft_consensus.cc:3060] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.904891 5865 leader_election.cc:290] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:29.906343 5635 raft_consensus.cc:2468] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.907327 5711 raft_consensus.cc:2468] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:29.907518 5526 leader_election.cc:304] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:29.908815 5865 raft_consensus.cc:2804] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 20:54:29.909431 5865 raft_consensus.cc:697] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:29.910176 5865 consensus_queue.cc:237] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:29.930138 5867 consensus_queue.cc:1048] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:29.940680 5805 consensus_queue.cc:1048] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:29.943714 5459 catalog_manager.cc:5654] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:29.949759 5635 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 0 FOLLOWER]: Advancing to term 1
I20251215 20:54:29.955852 5876 consensus_queue.cc:1048] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.146409 5865 consensus_queue.cc:1048] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.157018 5900 consensus_queue.cc:1048] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.158263 5636 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
mode: GRACEFUL
new_leader_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:35836
I20251215 20:54:30.158867 5636 raft_consensus.cc:606] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Received request to transfer leadership to TS 9ac534568c51434db437a84eb004db52
I20251215 20:54:30.165902 5711 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
mode: GRACEFUL
new_leader_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:59970
I20251215 20:54:30.166805 5711 raft_consensus.cc:606] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Received request to transfer leadership to TS 9ac534568c51434db437a84eb004db52
I20251215 20:54:30.174047 5562 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83"
dest_uuid: "9ac534568c51434db437a84eb004db52"
mode: GRACEFUL
new_leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:55588
I20251215 20:54:30.174466 5562 raft_consensus.cc:606] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Received request to transfer leadership to TS f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:30.180280 5562 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00"
dest_uuid: "9ac534568c51434db437a84eb004db52"
mode: GRACEFUL
new_leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:55588
I20251215 20:54:30.180693 5562 raft_consensus.cc:606] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Received request to transfer leadership to TS f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:30.184280 5711 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "339ca3e921e1499883173b6f68571fce"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
mode: GRACEFUL
new_leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:59970
I20251215 20:54:30.184674 5711 raft_consensus.cc:606] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Received request to transfer leadership to TS f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:30.188263 5562 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c"
dest_uuid: "9ac534568c51434db437a84eb004db52"
mode: GRACEFUL
new_leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
from {username='slave'} at 127.0.0.1:55588
I20251215 20:54:30.188689 5562 raft_consensus.cc:606] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Received request to transfer leadership to TS ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:30.204618 5900 consensus_queue.cc:1048] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.210825 5865 raft_consensus.cc:993] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52: : Instructing follower f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:30.211247 5895 raft_consensus.cc:1081] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Signalling peer f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:30.212651 5634 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:35818
I20251215 20:54:30.213250 5634 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:30.213660 5634 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.217998 5863 consensus_queue.cc:1048] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.220968 5634 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.221994 5635 raft_consensus.cc:1240] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Rejecting Update request from peer 9ac534568c51434db437a84eb004db52 for earlier term 1. Current term is 2. Ops: []
I20251215 20:54:30.223887 5863 consensus_queue.cc:1059] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.224723 5900 raft_consensus.cc:3055] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:30.225061 5900 raft_consensus.cc:740] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:30.225082 5562 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:30.225818 5900 consensus_queue.cc:260] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.226238 5634 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:30.226423 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:30.227138 5900 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.227128 5711 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.234169 5711 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:30.235285 5602 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:30.236011 5808 raft_consensus.cc:2804] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:30.236407 5808 raft_consensus.cc:697] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:30.237150 5808 consensus_queue.cc:237] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.238948 5562 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:30.245182 5458 catalog_manager.cc:5654] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 1 to 2, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 2 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:30.262480 5876 consensus_queue.cc:1048] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.276500 5884 consensus_queue.cc:1048] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.282950 5914 raft_consensus.cc:993] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b: : Instructing follower 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:30.283375 5884 raft_consensus.cc:1081] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Signalling peer 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:30.284729 5562 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f"
dest_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:55572
I20251215 20:54:30.285255 5562 raft_consensus.cc:493] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:30.285594 5562 raft_consensus.cc:3060] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.290438 5562 raft_consensus.cc:515] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.291780 5562 leader_election.cc:290] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:30.292757 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:30.293041 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:30.293331 5710 raft_consensus.cc:3055] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:30.293622 5634 raft_consensus.cc:3060] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.293633 5710 raft_consensus.cc:740] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:30.294557 5710 consensus_queue.cc:260] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.295771 5710 raft_consensus.cc:3060] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.299026 5634 raft_consensus.cc:2468] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:30.299980 5526 leader_election.cc:304] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:30.300714 5900 raft_consensus.cc:2804] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:30.301154 5900 raft_consensus.cc:697] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:30.301293 5710 raft_consensus.cc:2468] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:30.301956 5900 consensus_queue.cc:237] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.307668 5458 catalog_manager.cc:5654] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 1 to 2, leader changed from ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:30.377918 5900 raft_consensus.cc:993] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: : Instructing follower f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:30.378335 5900 raft_consensus.cc:1081] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Signalling peer f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:30.379786 5634 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:35818
I20251215 20:54:30.380338 5634 raft_consensus.cc:493] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:30.380463 5867 raft_consensus.cc:993] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: : Instructing follower 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:30.380736 5634 raft_consensus.cc:3060] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.380978 5808 raft_consensus.cc:1081] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Signalling peer 9ac534568c51434db437a84eb004db52 to start an election
I20251215 20:54:30.382510 5562 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30"
dest_uuid: "9ac534568c51434db437a84eb004db52"
from {username='slave'} at 127.0.0.1:55568
I20251215 20:54:30.383016 5562 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:30.384752 5562 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.388077 5634 raft_consensus.cc:515] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.389842 5634 leader_election.cc:290] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:30.389642 5562 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.390410 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:30.390816 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:30.390972 5561 raft_consensus.cc:3055] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:30.391338 5561 raft_consensus.cc:740] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:30.391515 5562 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:30.392275 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:30.392122 5561 consensus_queue.cc:260] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.392517 5711 raft_consensus.cc:3060] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.392614 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:30.392881 5635 raft_consensus.cc:3055] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:30.393229 5710 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.393204 5635 raft_consensus.cc:740] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:30.394132 5561 raft_consensus.cc:3060] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.394191 5635 consensus_queue.cc:260] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.395500 5635 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.399626 5710 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:30.400563 5561 raft_consensus.cc:2468] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:30.401341 5635 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:30.401263 5527 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:30.401691 5600 leader_election.cc:304] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:30.401897 5900 consensus_queue.cc:1048] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.402145 5711 raft_consensus.cc:2468] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:30.402259 5895 raft_consensus.cc:2804] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:30.402704 5808 raft_consensus.cc:2804] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:30.402812 5895 raft_consensus.cc:697] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:30.403360 5808 raft_consensus.cc:697] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:30.404062 5808 consensus_queue.cc:237] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.403944 5895 consensus_queue.cc:237] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.410032 5900 consensus_queue.cc:1048] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.413393 5863 raft_consensus.cc:993] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52: : Instructing follower ede15f5ea3a24a58a56e8caebd2dc41b to start an election
I20251215 20:54:30.412748 5458 catalog_manager.cc:5654] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 1 to 2, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:30.413815 5863 raft_consensus.cc:1081] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Signalling peer ede15f5ea3a24a58a56e8caebd2dc41b to start an election
I20251215 20:54:30.415553 5457 catalog_manager.cc:5654] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 1 to 2, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 2 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:30.420838 5711 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
from {username='slave'} at 127.0.0.1:59952
I20251215 20:54:30.421368 5711 raft_consensus.cc:493] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:30.421754 5711 raft_consensus.cc:3060] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.428081 5711 raft_consensus.cc:515] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.430444 5710 raft_consensus.cc:1240] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Rejecting Update request from peer 9ac534568c51434db437a84eb004db52 for earlier term 1. Current term is 2. Ops: []
I20251215 20:54:30.430482 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:30.431104 5561 raft_consensus.cc:3055] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:30.431401 5561 raft_consensus.cc:740] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:30.431548 5900 consensus_queue.cc:1059] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 20:54:30.432812 5711 leader_election.cc:290] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:30.432626 5561 consensus_queue.cc:260] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.433358 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43a1d5d92b924a2abdb9b294d761286c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:30.433585 5561 raft_consensus.cc:3060] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.433903 5634 raft_consensus.cc:3060] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.439677 5561 raft_consensus.cc:2468] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:30.440059 5634 raft_consensus.cc:2468] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:30.441066 5675 leader_election.cc:304] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:30.441990 5914 raft_consensus.cc:2804] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:30.442318 5914 raft_consensus.cc:697] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:30.443041 5914 consensus_queue.cc:237] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.449939 5457 catalog_manager.cc:5654] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 1 to 2, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:30.512722 5876 raft_consensus.cc:993] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b: : Instructing follower f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:30.513123 5914 raft_consensus.cc:1081] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Signalling peer f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:30.514339 5634 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "339ca3e921e1499883173b6f68571fce"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:35826
I20251215 20:54:30.514770 5634 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:30.515041 5634 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.519942 5634 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.521340 5634 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:30.522167 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:30.522302 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:30.522758 5561 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.522854 5711 raft_consensus.cc:3055] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:30.523202 5711 raft_consensus.cc:740] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:30.523746 5711 consensus_queue.cc:260] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.524564 5711 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:30.527776 5561 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:30.528409 5711 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:30.528987 5600 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:30.529697 5808 raft_consensus.cc:2804] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader election won for term 2
I20251215 20:54:30.530141 5808 raft_consensus.cc:697] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:30.530932 5808 consensus_queue.cc:237] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:30.539482 5457 catalog_manager.cc:5654] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 1 to 2, leader changed from ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131) to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 2 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:30.687304 5634 raft_consensus.cc:1275] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.688323 5863 consensus_queue.cc:1048] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.693413 5711 raft_consensus.cc:1275] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.694988 5895 consensus_queue.cc:1048] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.737985 5561 raft_consensus.cc:1275] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.739007 5808 consensus_queue.cc:1048] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.745872 5711 raft_consensus.cc:1275] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.747478 5808 consensus_queue.cc:1048] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.845945 5561 raft_consensus.cc:1275] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.846925 5914 consensus_queue.cc:1048] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.853634 5634 raft_consensus.cc:1275] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.855020 5914 consensus_queue.cc:1048] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.888530 5635 raft_consensus.cc:1275] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.889492 5895 consensus_queue.cc:1048] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.897027 5711 raft_consensus.cc:1275] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.898355 5895 consensus_queue.cc:1048] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.916462 5562 raft_consensus.cc:1275] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.917456 5808 consensus_queue.cc:1048] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:30.924583 5711 raft_consensus.cc:1275] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:30.926312 5861 consensus_queue.cc:1048] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:31.094704 5711 raft_consensus.cc:1275] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:31.095697 5861 consensus_queue.cc:1048] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:31.099519 5562 raft_consensus.cc:1275] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 20:54:31.100847 5867 consensus_queue.cc:1048] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:33.236043 5459 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35632:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20251215 20:54:33.254276 5459 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35632:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20251215 20:54:33.281633 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:33.366988 5957 tablet.cc:1722] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.392985 5963 tablet.cc:1722] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.417662 5968 tablet.cc:1722] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.434988 5965 tablet.cc:1722] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.438813 5971 tablet.cc:1722] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.441562 5975 tablet.cc:1722] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.454960 5976 tablet.cc:1722] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.457409 5974 tablet.cc:1722] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.459759 5968 tablet.cc:1722] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.476379 5635 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
mode: GRACEFUL
new_leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
from {username='slave'} at 127.0.0.1:45214
I20251215 20:54:33.477013 5635 raft_consensus.cc:606] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Received request to transfer leadership to TS ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:33.506220 5968 tablet.cc:1722] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.506933 5978 tablet.cc:1722] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.508950 5979 tablet.cc:1722] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20251215 20:54:33.515888 5977 log.cc:927] Time spent T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: Append to log took a long time: real 0.052s user 0.001s sys 0.000s
I20251215 20:54:33.520539 5981 tablet.cc:1722] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.522851 5974 tablet.cc:1722] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.526858 5975 tablet.cc:1722] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.534312 5971 tablet.cc:1722] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.537688 5963 tablet.cc:1722] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.519042 5980 tablet.cc:1722] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.548413 5965 tablet.cc:1722] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.575320 5957 tablet.cc:1722] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.554702 5975 tablet.cc:1722] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.546423 5979 tablet.cc:1722] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.607741 5965 tablet.cc:1722] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.614622 5980 tablet.cc:1722] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.622153 5562 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c13de8b1518d44739e99be20483c275b"
dest_uuid: "9ac534568c51434db437a84eb004db52"
mode: GRACEFUL
new_leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
from {username='slave'} at 127.0.0.1:44712
I20251215 20:54:33.622726 5562 raft_consensus.cc:606] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Received request to transfer leadership to TS ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:33.625190 5981 tablet.cc:1722] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.615192 5957 tablet.cc:1722] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.620158 5971 tablet.cc:1722] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20251215 20:54:33.667104 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251215 20:54:33.673027 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:33.706635 5924 raft_consensus.cc:993] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52: : Instructing follower ede15f5ea3a24a58a56e8caebd2dc41b to start an election
I20251215 20:54:33.707438 5924 raft_consensus.cc:1081] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Signalling peer ede15f5ea3a24a58a56e8caebd2dc41b to start an election
I20251215 20:54:33.709030 5458 catalog_manager.cc:6199] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57: soft_deleted_table [id=182a4e430bd44c02a273fb611290db9d] alter complete (version 1)
I20251215 20:54:33.709973 5710 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c13de8b1518d44739e99be20483c275b"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
from {username='slave'} at 127.0.0.1:59952
I20251215 20:54:33.711354 5710 raft_consensus.cc:493] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:33.711676 5710 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:33.719570 5710 raft_consensus.cc:515] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:33.721000 5710 leader_election.cc:290] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:33.722090 5559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:33.722554 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:33.722752 5559 raft_consensus.cc:3055] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:33.723124 5559 raft_consensus.cc:740] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:33.723196 5635 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:33.723924 5559 consensus_queue.cc:260] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:33.725370 5559 raft_consensus.cc:3060] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:33.728437 5635 raft_consensus.cc:2468] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:33.729624 5675 leader_election.cc:304] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:33.730399 5927 raft_consensus.cc:2804] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:33.730758 5927 raft_consensus.cc:697] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:33.731393 5559 raft_consensus.cc:2468] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:33.731770 5927 consensus_queue.cc:237] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:33.742189 5923 raft_consensus.cc:993] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed: : Instructing follower ede15f5ea3a24a58a56e8caebd2dc41b to start an election
I20251215 20:54:33.742744 5923 raft_consensus.cc:1081] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Signalling peer ede15f5ea3a24a58a56e8caebd2dc41b to start an election
I20251215 20:54:33.744200 5710 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0"
dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
from {username='slave'} at 127.0.0.1:59966
I20251215 20:54:33.743863 5459 catalog_manager.cc:5654] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 2 to 3, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:33.744678 5710 raft_consensus.cc:493] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:33.744989 5710 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:33.750301 5710 raft_consensus.cc:515] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:33.752202 5710 leader_election.cc:290] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:33.752585 5559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:33.752857 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:33.753417 5635 raft_consensus.cc:3055] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:33.753443 5559 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:33.754213 5635 raft_consensus.cc:740] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:33.755067 5635 consensus_queue.cc:260] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:33.756229 5635 raft_consensus.cc:3060] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:33.759394 5559 raft_consensus.cc:2468] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:33.760571 5674 leader_election.cc:304] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:33.761142 5927 raft_consensus.cc:2804] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:33.761214 5635 raft_consensus.cc:2468] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:33.761528 5927 raft_consensus.cc:697] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:33.762523 5927 consensus_queue.cc:237] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:33.769275 5459 catalog_manager.cc:5654] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 2 to 3, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
W20251215 20:54:34.015462 5491 debug-util.cc:398] Leaking SignalData structure 0x7b08000542a0 after lost signal to thread 429
W20251215 20:54:34.016522 5491 debug-util.cc:398] Leaking SignalData structure 0x7b08000afac0 after lost signal to thread 5494
W20251215 20:54:34.019217 5491 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa340 after lost signal to thread 5735
I20251215 20:54:34.112246 5635 raft_consensus.cc:1275] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:34.113582 5927 consensus_queue.cc:1048] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:34.126731 5559 raft_consensus.cc:1275] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:34.132413 5993 consensus_queue.cc:1048] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20251215 20:54:34.194242 5635 raft_consensus.cc:1275] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:34.195412 5927 consensus_queue.cc:1048] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:34.208598 5559 raft_consensus.cc:1275] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:34.210067 5884 consensus_queue.cc:1048] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:34.674898 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:34.682348 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:34.682842 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:35.683779 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:35.690953 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:35.691466 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:36.692317 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:36.697072 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:36.697407 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:37.698110 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:37.702680 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:37.703004 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:38.703751 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:38.709131 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:38.709565 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:39.710433 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:39.716954 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:39.717448 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:41.820449 6015 raft_consensus.cc:493] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:41.821163 6015 raft_consensus.cc:515] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.824281 6015 leader_election.cc:290] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:41.944638 6017 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:41.847425 6014 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:41.946372 6017 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.946563 6014 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.948500 6017 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.935588 6013 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:41.949036 6017 raft_consensus.cc:493] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:41.949201 6013 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.949543 6017 raft_consensus.cc:515] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.950963 6017 leader_election.cc:290] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.951380 6013 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.952169 6015 raft_consensus.cc:493] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:41.948733 6014 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:41.952898 6015 raft_consensus.cc:515] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.954344 6013 raft_consensus.cc:493] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:41.954177 6017 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:41.955165 6017 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.955651 6015 leader_election.cc:290] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:41.958756 6017 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.959328 6013 raft_consensus.cc:515] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.959897 6018 raft_consensus.cc:493] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ede15f5ea3a24a58a56e8caebd2dc41b)
I20251215 20:54:41.960477 6018 raft_consensus.cc:515] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.961323 6013 leader_election.cc:290] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.963057 6018 leader_election.cc:290] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:41.954588 6019 raft_consensus.cc:493] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:41.972211 6019 raft_consensus.cc:515] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.974283 6013 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:41.974457 6019 leader_election.cc:290] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.967056 6020 raft_consensus.cc:493] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ede15f5ea3a24a58a56e8caebd2dc41b)
I20251215 20:54:41.975175 6013 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.975533 6020 raft_consensus.cc:515] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.977566 6020 leader_election.cc:290] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:41.974740 6017 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:41.978598 6017 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.980474 6017 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.982438 5709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:41.985142 5706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:41.987350 6018 raft_consensus.cc:493] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:41.987840 6018 raft_consensus.cc:515] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.989658 6018 leader_election.cc:290] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:41.990736 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "994f1a59a8c54245bfbd9100395e6a41" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:41.991711 6013 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.992033 6025 raft_consensus.cc:493] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:41.995200 6025 raft_consensus.cc:515] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:41.996374 6021 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:41.997556 6025 leader_election.cc:290] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:41.998253 6018 raft_consensus.cc:493] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:41.999396 6020 raft_consensus.cc:493] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.000030 6022 raft_consensus.cc:493] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.001820 5637 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.024534 6018 raft_consensus.cc:515] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.024789 6020 raft_consensus.cc:515] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.003176 5633 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "994f1a59a8c54245bfbd9100395e6a41" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.026458 6018 leader_election.cc:290] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.026469 6020 leader_election.cc:290] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.024536 6022 raft_consensus.cc:515] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.029034 5628 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.029620 6021 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.030404 6022 leader_election.cc:290] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.030884 6022 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.031345 6022 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.032050 5628 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.024133 6028 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.032986 6028 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.033766 5705 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6705aa242e244c4ca9502545a1a8465a" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.006570 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.034653 6021 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.034888 6028 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.009289 6014 raft_consensus.cc:493] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ede15f5ea3a24a58a56e8caebd2dc41b)
I20251215 20:54:42.012110 5632 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.035776 5632 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:42.035667 6014 raft_consensus.cc:515] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.014305 5631 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.036613 5637 raft_consensus.cc:2468] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:42.017644 5630 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.020617 5629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.037832 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.039021 5526 leader_election.cc:304] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.050762 6018 raft_consensus.cc:2749] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:54:42.015954 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.052620 5634 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:42.052785 5629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.053761 5704 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.039438 5705 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.041340 5706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.055533 5629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.055648 5559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.056209 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.056983 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.057541 5561 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:42.057621 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.058218 5560 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:42.042173 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.042855 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.059230 5559 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b80e077e39454d528d3529f61a99d59f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.059815 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.042984 6026 raft_consensus.cc:493] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.044018 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73a5617219cb4d54a353faa8c01e1d00" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.045215 6022 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.045482 5707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.061278 5707 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 2.
I20251215 20:54:42.045940 6014 leader_election.cc:290] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:41.996958 6023 raft_consensus.cc:493] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ede15f5ea3a24a58a56e8caebd2dc41b)
I20251215 20:54:42.062417 6023 raft_consensus.cc:515] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.062882 5561 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.064375 5561 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:42.064755 5557 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.064944 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6705aa242e244c4ca9502545a1a8465a" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.065382 5557 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:42.066793 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6705aa242e244c4ca9502545a1a8465a" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.067054 5675 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:42.062183 5526 leader_election.cc:304] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.067935 6025 raft_consensus.cc:2804] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:42.068322 6025 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:42.068658 6025 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.069468 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.070434 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.070818 5629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.068591 5526 leader_election.cc:304] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:42.073361 5526 leader_election.cc:304] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.069361 6022 raft_consensus.cc:2749] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:54:42.073616 6031 raft_consensus.cc:2804] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:42.074127 6027 raft_consensus.cc:2749] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:54:42.074249 6031 raft_consensus.cc:493] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ede15f5ea3a24a58a56e8caebd2dc41b)
I20251215 20:54:42.074882 6031 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.047132 5709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.058477 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49cc5941ee674923ac97bde1cb66b06f" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.073688 6023 leader_election.cc:290] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.076375 5526 leader_election.cc:304] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.046959 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6705aa242e244c4ca9502545a1a8465a" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.078238 5556 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.074682 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.078841 6023 raft_consensus.cc:2749] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.079082 5526 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.079864 6023 raft_consensus.cc:2749] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.081113 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.084244 5527 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.084612 5710 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13de8b1518d44739e99be20483c275b" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.085047 6023 raft_consensus.cc:2804] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:42.085412 6023 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.085759 6023 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.084640 5709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9bcb474df1d47db9f8c873f18d61aa0" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:42.088908 5602 leader_election.cc:304] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:42.089290 6031 raft_consensus.cc:515] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.089659 6014 raft_consensus.cc:2749] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:54:42.091226 5602 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:42.091853 6014 raft_consensus.cc:2749] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.092864 5527 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.093582 6031 leader_election.cc:290] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.094169 6031 raft_consensus.cc:2749] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.094792 5709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:42.094928 6025 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.070868 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.061298 6026 raft_consensus.cc:515] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.096764 5711 raft_consensus.cc:2468] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 1.
I20251215 20:54:42.097756 6026 leader_election.cc:290] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:42.098230 5674 leader_election.cc:304] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.096987 6025 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:42.099009 5527 leader_election.cc:304] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.099736 6025 raft_consensus.cc:2804] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:54:42.099660 5636 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.099020 5526 leader_election.cc:304] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.100909 6025 raft_consensus.cc:493] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.099112 5674 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.101428 6022 raft_consensus.cc:2804] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 20:54:42.101456 6031 raft_consensus.cc:2749] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:54:42.102002 6022 raft_consensus.cc:493] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.102077 6019 raft_consensus.cc:2804] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:42.102751 6022 raft_consensus.cc:3060] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:42.102777 6019 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.103318 6019 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.101292 5675 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52
I20251215 20:54:42.104413 6017 raft_consensus.cc:2804] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:42.104754 6017 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:42.105104 6017 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.108319 6019 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.108882 5674 leader_election.cc:304] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.109622 6013 raft_consensus.cc:2749] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.110203 6019 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:42.111323 6022 raft_consensus.cc:515] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.112375 6017 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.113001 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.101305 6023 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.113458 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.113094 5629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:42.101336 6025 raft_consensus.cc:3060] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:42.116330 6017 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:42.114182 5600 leader_election.cc:304] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:42.114717 5526 leader_election.cc:304] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.117306 6024 raft_consensus.cc:2749] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251215 20:54:42.117614 5600 leader_election.cc:304] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:42.118124 5629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.118623 6027 raft_consensus.cc:2749] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.119112 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.119438 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:42.119962 6024 raft_consensus.cc:2749] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.114454 5674 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.121212 5527 leader_election.cc:304] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.121886 6027 raft_consensus.cc:2749] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:54:42.122056 6022 leader_election.cc:290] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 2 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.121865 6025 raft_consensus.cc:515] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.121477 5674 leader_election.cc:304] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.123595 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:42.123965 6025 leader_election.cc:290] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:42.124313 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:42.124529 5674 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.125228 6019 raft_consensus.cc:2804] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:42.125597 6019 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.124540 6025 raft_consensus.cc:2749] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:54:42.126083 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.126207 6019 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.126439 6023 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:42.122010 6017 raft_consensus.cc:2804] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:42.127174 6017 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:42.127374 5526 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac534568c51434db437a84eb004db52; no voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.127525 6017 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.131304 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:42.131827 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:42.132334 6023 raft_consensus.cc:2749] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.132469 6017 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.133158 5674 leader_election.cc:304] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.133375 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.133066 6019 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.133948 6013 raft_consensus.cc:2749] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.134533 6017 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:42.135099 6019 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:42.135896 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:42.136533 5556 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:42.136794 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.138111 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:42.138545 5556 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:42.140278 5556 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:42.140403 5674 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.140516 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:42.140805 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:42.141372 5674 leader_election.cc:304] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.141899 6017 raft_consensus.cc:2749] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.142124 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:42.142268 5674 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.142470 6019 raft_consensus.cc:2749] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 20:54:42.143224 5674 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.143271 6019 raft_consensus.cc:2749] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.143750 6013 raft_consensus.cc:2749] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.144102 5674 leader_election.cc:304] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.144690 6013 raft_consensus.cc:2749] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251215 20:54:42.145040 5674 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.145581 6013 raft_consensus.cc:2749] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.145953 5674 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b; no voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:42.146485 6013 raft_consensus.cc:2749] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251215 20:54:42.264685 5708 raft_consensus.cc:1240] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Rejecting Update request from peer f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 1. Current term is 2. Ops: []
I20251215 20:54:42.265799 6024 consensus_queue.cc:1059] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:42.266481 6015 raft_consensus.cc:3055] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:42.266750 6015 raft_consensus.cc:740] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:42.267391 6015 consensus_queue.cc:260] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.268359 6015 raft_consensus.cc:3060] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:42.396202 5558 raft_consensus.cc:1240] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Rejecting Update request from peer f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 1. Current term is 2. Ops: []
I20251215 20:54:42.397239 6015 consensus_queue.cc:1059] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:42.397924 6024 raft_consensus.cc:3055] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Stepping down as leader of term 1
I20251215 20:54:42.398195 6024 raft_consensus.cc:740] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:42.398818 6024 consensus_queue.cc:260] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.399724 6024 raft_consensus.cc:3060] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Advancing to term 2
I20251215 20:54:42.467136 5708 raft_consensus.cc:1240] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Rejecting Update request from peer f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 2. Current term is 3. Ops: []
I20251215 20:54:42.468112 6024 consensus_queue.cc:1059] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:42.468823 6015 raft_consensus.cc:3055] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:42.469096 6015 raft_consensus.cc:740] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:42.469704 6015 consensus_queue.cc:260] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.470624 6015 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
W20251215 20:54:42.518676 5732 debug-util.cc:398] Leaking SignalData structure 0x7b080004d4a0 after lost signal to thread 429
W20251215 20:54:42.519484 5732 debug-util.cc:398] Leaking SignalData structure 0x7b080037a480 after lost signal to thread 5494
W20251215 20:54:42.520385 5732 debug-util.cc:398] Leaking SignalData structure 0x7b080015a140 after lost signal to thread 5586
W20251215 20:54:42.521162 5732 debug-util.cc:398] Leaking SignalData structure 0x7b08001975c0 after lost signal to thread 5661
W20251215 20:54:42.521919 5732 debug-util.cc:398] Leaking SignalData structure 0x7b08002faac0 after lost signal to thread 5735
I20251215 20:54:42.523885 5708 raft_consensus.cc:1240] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Rejecting Update request from peer 9ac534568c51434db437a84eb004db52 for earlier term 2. Current term is 3. Ops: []
I20251215 20:54:42.525038 6023 consensus_queue.cc:1059] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:42.525923 6022 raft_consensus.cc:3055] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:42.526185 6022 raft_consensus.cc:740] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:42.526794 6022 consensus_queue.cc:260] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.527732 6022 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.551370 5708 raft_consensus.cc:1240] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Rejecting Update request from peer f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 2. Current term is 3. Ops: []
I20251215 20:54:42.552436 6015 consensus_queue.cc:1059] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:42.553329 6024 raft_consensus.cc:3055] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:42.553640 6024 raft_consensus.cc:740] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:42.554243 6024 consensus_queue.cc:260] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.555181 6024 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.572103 5708 raft_consensus.cc:1240] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Rejecting Update request from peer f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 2. Current term is 3. Ops: []
I20251215 20:54:42.573215 6024 consensus_queue.cc:1059] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:42.574096 6015 raft_consensus.cc:3055] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:42.574369 6015 raft_consensus.cc:740] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:42.574990 6015 consensus_queue.cc:260] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.575906 6015 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.589295 5708 raft_consensus.cc:1240] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Rejecting Update request from peer 9ac534568c51434db437a84eb004db52 for earlier term 2. Current term is 3. Ops: []
I20251215 20:54:42.590540 6023 consensus_queue.cc:1059] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:42.591401 6022 raft_consensus.cc:3055] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:42.591714 6022 raft_consensus.cc:740] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:42.592027 5558 raft_consensus.cc:1240] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Rejecting Update request from peer ede15f5ea3a24a58a56e8caebd2dc41b for earlier term 2. Current term is 3. Ops: []
I20251215 20:54:42.592407 6022 consensus_queue.cc:260] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.593429 6013 consensus_queue.cc:1059] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:42.593673 6022 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:42.594288 6017 raft_consensus.cc:3055] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:42.594647 6017 raft_consensus.cc:740] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:42.595558 6017 consensus_queue.cc:260] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:42.596908 6017 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:43.132707 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:43.137494 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251215 20:54:43.138011 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:43.452324 6015 raft_consensus.cc:493] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:43.452895 6015 raft_consensus.cc:515] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.455237 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:43.455593 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:43.454782 6015 leader_election.cc:290] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.456835 5602 leader_election.cc:304] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:43.457379 6015 raft_consensus.cc:2749] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 20:54:43.583983 6015 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:43.584460 6015 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.586025 6015 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.586835 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:43.586997 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:43.587541 5558 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 3.
I20251215 20:54:43.587857 5708 raft_consensus.cc:2393] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f13926e3f3cd4a85998b5d16f2bc85ed in current term 3: Already voted for candidate ede15f5ea3a24a58a56e8caebd2dc41b in this term.
I20251215 20:54:43.588814 5600 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:43.589391 6015 raft_consensus.cc:2804] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:43.589747 6015 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ac534568c51434db437a84eb004db52)
I20251215 20:54:43.590075 6015 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:43.596866 6015 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.598627 6015 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.599248 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:43.599406 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:43.600167 5708 raft_consensus.cc:2393] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f13926e3f3cd4a85998b5d16f2bc85ed in current term 3: Already voted for candidate ede15f5ea3a24a58a56e8caebd2dc41b in this term.
I20251215 20:54:43.604210 5558 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 3.
I20251215 20:54:43.605070 5600 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:43.605682 6015 raft_consensus.cc:2804] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:43.606659 6015 raft_consensus.cc:697] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:43.607944 6015 consensus_queue.cc:237] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.617686 5459 catalog_manager.cc:5654] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 2 to 3, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 3 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:43.627939 6015 raft_consensus.cc:493] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:43.628469 6015 raft_consensus.cc:515] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.630245 6015 leader_election.cc:290] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.631071 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:43.631240 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:43.631745 5558 raft_consensus.cc:2468] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 2.
I20251215 20:54:43.631798 5708 raft_consensus.cc:2468] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 1.
I20251215 20:54:43.632928 5600 leader_election.cc:304] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:43.633586 6015 raft_consensus.cc:2804] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:43.633917 6015 raft_consensus.cc:493] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:43.634132 6015 raft_consensus.cc:3060] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:43.638796 6015 raft_consensus.cc:515] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.640093 6015 leader_election.cc:290] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.640861 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:43.640964 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3e90b779264349adea5ecfa16f0925" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:43.641510 5558 raft_consensus.cc:3060] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:43.641541 5708 raft_consensus.cc:3060] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Advancing to term 3
I20251215 20:54:43.646118 5708 raft_consensus.cc:2468] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 3.
I20251215 20:54:43.646881 5602 leader_election.cc:304] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:43.647403 6015 raft_consensus.cc:2804] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:43.647760 6015 raft_consensus.cc:697] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:43.648435 6015 consensus_queue.cc:237] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.648576 5558 raft_consensus.cc:2468] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 3.
I20251215 20:54:43.655611 5459 catalog_manager.cc:5654] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:43.722718 6017 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:43.723760 6017 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.726073 6017 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:43.728094 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:43.728107 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:43.729183 5558 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:43.729316 5635 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:43.730465 5674 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:43.731228 6017 raft_consensus.cc:2804] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:54:43.731561 6017 raft_consensus.cc:493] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:43.731950 6017 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.735581 6040 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:43.736430 6040 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.738809 6040 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:43.739475 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:43.740676 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:43.741600 5635 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:43.742642 5675 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52
I20251215 20:54:43.743497 6040 raft_consensus.cc:2804] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:54:43.743537 6017 raft_consensus.cc:515] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.743963 6040 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:43.744412 6040 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.745502 6017 leader_election.cc:290] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:43.746132 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:43.746553 5558 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.750164 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "462e94dfc865452fa0db5814f01e7001" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:43.750614 6022 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:43.750783 5635 raft_consensus.cc:3060] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.751410 6022 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.753263 6040 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.753836 6022 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.756358 6040 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:43.756831 5629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:43.757642 5629 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.758884 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:43.759721 5708 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 3.
I20251215 20:54:43.760360 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:43.761309 5634 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 3.
I20251215 20:54:43.761339 5527 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:43.762373 6022 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:43.762570 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:43.763116 6022 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.773962 6022 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.774494 6022 raft_consensus.cc:2804] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:54:43.774821 6022 raft_consensus.cc:493] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:43.775131 6022 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.778455 5635 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 4.
I20251215 20:54:43.780030 5675 leader_election.cc:304] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:43.781440 6040 raft_consensus.cc:2804] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:54:43.781533 5558 raft_consensus.cc:2468] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 4.
I20251215 20:54:43.782543 6040 raft_consensus.cc:697] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:43.783792 6040 consensus_queue.cc:237] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.781912 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:43.787289 5708 raft_consensus.cc:2393] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ac534568c51434db437a84eb004db52 in current term 3: Already voted for candidate ede15f5ea3a24a58a56e8caebd2dc41b in this term.
I20251215 20:54:43.785985 6022 raft_consensus.cc:515] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.791002 6022 leader_election.cc:290] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.792425 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:43.792989 5629 raft_consensus.cc:2468] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 4.
I20251215 20:54:43.793170 5635 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 3.
I20251215 20:54:43.794514 5675 leader_election.cc:304] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52
I20251215 20:54:43.795171 5526 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: ede15f5ea3a24a58a56e8caebd2dc41b
I20251215 20:54:43.796116 6022 raft_consensus.cc:2804] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:43.796162 6017 raft_consensus.cc:2804] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:54:43.797492 6022 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:43.797756 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:43.797962 6022 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:43.798421 5708 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.798393 5459 catalog_manager.cc:5654] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 2 to 4, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 4 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:43.807482 5708 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 4.
I20251215 20:54:43.807688 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4432e6787ca40df96ccb85f083448a1" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:43.808311 5635 raft_consensus.cc:3060] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.808841 5527 leader_election.cc:304] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:43.809721 6041 raft_consensus.cc:2804] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:54:43.810154 6041 raft_consensus.cc:697] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 4 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:43.811239 6041 consensus_queue.cc:237] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.815490 5635 raft_consensus.cc:2468] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 4.
I20251215 20:54:43.821440 6022 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.822897 6017 raft_consensus.cc:697] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:43.824100 6017 consensus_queue.cc:237] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.825512 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:43.828150 6044 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:43.828840 6044 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.831889 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:43.832528 5558 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:43.833881 5674 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:43.834666 6040 raft_consensus.cc:2804] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:54:43.835018 6040 raft_consensus.cc:493] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:43.835353 6040 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.841339 6022 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.842489 5635 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 3.
I20251215 20:54:43.843636 6040 raft_consensus.cc:515] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.843937 5526 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:43.844967 6022 raft_consensus.cc:2804] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:43.845531 6022 raft_consensus.cc:697] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 3 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:43.845793 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:43.846645 5708 raft_consensus.cc:2368] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ac534568c51434db437a84eb004db52 for earlier term 3. Current term is 4.
I20251215 20:54:43.846496 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:43.846849 6022 consensus_queue.cc:237] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.848094 5527 leader_election.cc:400] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 election: Vote denied by peer ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761) with higher term. Message: Invalid argument: T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ac534568c51434db437a84eb004db52 for earlier term 3. Current term is 4.
I20251215 20:54:43.848729 6040 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:43.849817 6042 raft_consensus.cc:493] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:43.849907 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:43.850387 6042 raft_consensus.cc:515] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.850775 6044 leader_election.cc:290] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:43.851992 5635 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.852526 6042 leader_election.cc:290] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.853781 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "339ca3e921e1499883173b6f68571fce" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:43.856725 5634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:43.857987 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:43.858741 5708 raft_consensus.cc:2468] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 3.
I20251215 20:54:43.859869 5527 leader_election.cc:304] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:43.860903 6042 raft_consensus.cc:2804] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:54:43.861248 6042 raft_consensus.cc:493] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:43.861563 6042 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.864416 5635 raft_consensus.cc:2468] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 4.
I20251215 20:54:43.863575 5459 catalog_manager.cc:5654] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 2 to 4, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 4 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:43.866094 5675 leader_election.cc:304] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters: 9ac534568c51434db437a84eb004db52
I20251215 20:54:43.869180 6017 raft_consensus.cc:2804] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:54:43.869850 6017 raft_consensus.cc:697] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:43.870903 6017 consensus_queue.cc:237] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.872807 5460 catalog_manager.cc:5654] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 2 to 4, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 4 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:43.894230 6042 raft_consensus.cc:515] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.896646 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:43.897280 5460 catalog_manager.cc:5654] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 2 to 3, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 3 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:43.902870 6042 leader_election.cc:290] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 election: Requested vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.903916 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:43.904500 5708 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.909113 5459 catalog_manager.cc:5654] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 3 to 4, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 4 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:43.911942 5708 raft_consensus.cc:2468] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac534568c51434db437a84eb004db52 in term 4.
I20251215 20:54:43.912717 5527 leader_election.cc:304] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:43.913240 6042 raft_consensus.cc:2804] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:54:43.913686 6042 raft_consensus.cc:697] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 4 LEADER]: Becoming Leader. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:43.914597 6042 consensus_queue.cc:237] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.923556 5459 catalog_manager.cc:5654] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 reported cstate change: term changed from 2 to 4, leader changed from ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131) to 9ac534568c51434db437a84eb004db52 (127.0.106.129). New cstate: current_term: 4 leader_uuid: "9ac534568c51434db437a84eb004db52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:43.926149 6015 raft_consensus.cc:493] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ede15f5ea3a24a58a56e8caebd2dc41b)
I20251215 20:54:43.926818 6015 raft_consensus.cc:515] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:43.928927 6015 leader_election.cc:290] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:43.929484 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:43.929865 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f267b5f2804642939f1b2cb3c4c54545" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:43.930627 5708 raft_consensus.cc:2368] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 3. Current term is 4.
I20251215 20:54:43.931548 5602 leader_election.cc:400] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Vote denied by peer ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761) with higher term. Message: Invalid argument: T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 3. Current term is 4.
I20251215 20:54:43.931802 5602 leader_election.cc:403] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20251215 20:54:43.932364 6015 raft_consensus.cc:3060] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 4
I20251215 20:54:43.940672 6015 raft_consensus.cc:2749] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761) with higher term. Message: Invalid argument: T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 3. Current term is 4.
I20251215 20:54:44.002593 6042 raft_consensus.cc:493] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f13926e3f3cd4a85998b5d16f2bc85ed)
I20251215 20:54:44.003283 6042 raft_consensus.cc:515] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.005234 6042 leader_election.cc:290] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:44.005808 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:44.006407 5635 raft_consensus.cc:2368] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ac534568c51434db437a84eb004db52 for earlier term 3. Current term is 4.
I20251215 20:54:44.006163 5708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c4ee2039d89423297fedad862ed6c83" candidate_uuid: "9ac534568c51434db437a84eb004db52" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" is_pre_election: true
I20251215 20:54:44.007259 5526 leader_election.cc:400] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Vote denied by peer f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951) with higher term. Message: Invalid argument: T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ac534568c51434db437a84eb004db52 for earlier term 3. Current term is 4.
I20251215 20:54:44.007524 5526 leader_election.cc:403] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20251215 20:54:44.007983 6042 raft_consensus.cc:3060] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 4
I20251215 20:54:44.012637 6042 raft_consensus.cc:2749] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951) with higher term. Message: Invalid argument: T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ac534568c51434db437a84eb004db52 for earlier term 3. Current term is 4.
I20251215 20:54:44.083580 6017 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:44.084044 6017 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.085574 6017 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:44.086374 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:44.087006 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:44.087141 5558 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:44.088073 5560 raft_consensus.cc:1275] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:54:44.088369 5674 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters:
I20251215 20:54:44.089148 6017 raft_consensus.cc:2804] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251215 20:54:44.089497 6017 raft_consensus.cc:493] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:44.089777 6017 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:44.089629 6015 consensus_queue.cc:1048] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:54:44.097169 6017 raft_consensus.cc:515] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.101611 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:44.102142 5560 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:44.106719 5708 raft_consensus.cc:1275] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:54:44.108474 6017 leader_election.cc:290] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:44.109920 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79da44dccd03456b9a38946441f0bc30" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:44.108350 6032 consensus_queue.cc:1048] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20251215 20:54:44.118080 6044 raft_consensus.cc:493] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 20:54:44.118605 6044 raft_consensus.cc:515] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.120563 6044 leader_election.cc:290] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:44.121603 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" is_pre_election: true
I20251215 20:54:44.122288 5635 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 2.
I20251215 20:54:44.122836 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52" is_pre_election: true
I20251215 20:54:44.123359 5675 leader_election.cc:304] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:44.123561 5558 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 1.
I20251215 20:54:44.124711 6017 raft_consensus.cc:2804] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251215 20:54:44.125075 6017 raft_consensus.cc:493] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 20:54:44.125414 6017 raft_consensus.cc:3060] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:44.130352 5560 raft_consensus.cc:2468] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 4.
I20251215 20:54:44.131444 5674 leader_election.cc:304] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ac534568c51434db437a84eb004db52, ede15f5ea3a24a58a56e8caebd2dc41b; no voters: f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:44.132464 6044 raft_consensus.cc:2804] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Leader election won for term 4
I20251215 20:54:44.132503 6017 raft_consensus.cc:515] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.133011 6044 raft_consensus.cc:697] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:44.134014 6044 consensus_queue.cc:237] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.136447 5635 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
I20251215 20:54:44.136642 5560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9095c04828a243cf986895f9ad500b4c" candidate_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:44.137060 5635 raft_consensus.cc:3060] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:44.137493 5560 raft_consensus.cc:3060] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Advancing to term 3
I20251215 20:54:44.139128 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251215 20:54:44.143575 5635 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:44.144591 5675 leader_election.cc:304] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:44.145366 6040 raft_consensus.cc:2804] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:44.149430 5558 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d"
dest_uuid: "9ac534568c51434db437a84eb004db52"
mode: GRACEFUL
new_leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:44712
I20251215 20:54:44.150163 5558 raft_consensus.cc:606] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Received request to transfer leadership to TS f13926e3f3cd4a85998b5d16f2bc85ed
I20251215 20:54:44.151026 5560 raft_consensus.cc:2468] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ede15f5ea3a24a58a56e8caebd2dc41b in term 3.
I20251215 20:54:44.151839 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251215 20:54:44.152979 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251215 20:54:44.157722 5560 raft_consensus.cc:1240] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Rejecting Update request from peer f13926e3f3cd4a85998b5d16f2bc85ed for earlier term 3. Current term is 4. Ops: []
I20251215 20:54:44.159276 6015 consensus_queue.cc:1059] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:44.160077 6032 raft_consensus.cc:3055] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:54:44.160442 6032 raft_consensus.cc:740] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:44.161374 6032 consensus_queue.cc:260] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.162810 6032 raft_consensus.cc:3060] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:44.174386 6017 leader_election.cc:290] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951)
I20251215 20:54:44.179383 6040 raft_consensus.cc:697] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 LEADER]: Becoming Leader. State: Replica: ede15f5ea3a24a58a56e8caebd2dc41b, State: Running, Role: LEADER
I20251215 20:54:44.180546 6040 consensus_queue.cc:237] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.193290 5459 catalog_manager.cc:5654] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 3 to 4, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 4 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:44.194455 5459 catalog_manager.cc:5654] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b reported cstate change: term changed from 1 to 3, leader changed from f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130) to ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: HEALTHY } } }
I20251215 20:54:44.198707 5635 raft_consensus.cc:1275] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:54:44.199990 6040 consensus_queue.cc:1048] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:44.210708 5560 raft_consensus.cc:1275] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:54:44.212038 6040 consensus_queue.cc:1048] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:44.257929 5560 raft_consensus.cc:1275] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:54:44.258965 6040 consensus_queue.cc:1048] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:44.267648 5635 raft_consensus.cc:1275] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:54:44.269109 6040 consensus_queue.cc:1048] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:44.295825 5711 raft_consensus.cc:1240] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Rejecting Update request from peer 9ac534568c51434db437a84eb004db52 for earlier term 3. Current term is 4. Ops: []
I20251215 20:54:44.297009 6042 consensus_queue.cc:1059] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:44.297525 6042 consensus_queue.cc:1243] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [LEADER]: Peer ede15f5ea3a24a58a56e8caebd2dc41b log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20251215 20:54:44.297988 6048 raft_consensus.cc:3055] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 3 LEADER]: Stepping down as leader of term 3
I20251215 20:54:44.298228 6048 raft_consensus.cc:740] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:44.298832 6048 consensus_queue.cc:260] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.299641 6048 raft_consensus.cc:3060] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Advancing to term 4
I20251215 20:54:44.305220 5635 raft_consensus.cc:1275] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:54:44.306372 6048 consensus_queue.cc:1048] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:44.314802 5711 raft_consensus.cc:1275] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:54:44.315996 6048 consensus_queue.cc:1048] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:44.326754 5560 raft_consensus.cc:1275] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20251215 20:54:44.327075 5560 pending_rounds.cc:85] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: Aborting all ops after (but not including) 3
I20251215 20:54:44.327291 5560 pending_rounds.cc:107] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20251215 20:54:44.327539 5560 raft_consensus.cc:2889] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:54:44.328985 6017 consensus_queue.cc:1048] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:44.338698 5635 raft_consensus.cc:1275] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:54:44.340029 6017 consensus_queue.cc:1048] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:44.355013 5635 raft_consensus.cc:1275] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:54:44.356081 6048 consensus_queue.cc:1048] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:44.367882 5711 raft_consensus.cc:1275] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Refusing update from remote peer 9ac534568c51434db437a84eb004db52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20251215 20:54:44.369263 6042 consensus_queue.cc:1048] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:44.425770 6041 raft_consensus.cc:993] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52: : Instructing follower f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:44.426177 6042 raft_consensus.cc:1081] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Signalling peer f13926e3f3cd4a85998b5d16f2bc85ed to start an election
I20251215 20:54:44.427420 5635 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d"
dest_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed"
from {username='slave'} at 127.0.0.1:35818
I20251215 20:54:44.427856 5635 raft_consensus.cc:493] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251215 20:54:44.428087 5635 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:44.433568 5635 raft_consensus.cc:515] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.435031 5635 leader_election.cc:290] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 election: Requested vote from peers 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493), ede15f5ea3a24a58a56e8caebd2dc41b (127.0.106.131:42761)
I20251215 20:54:44.435957 5558 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ac534568c51434db437a84eb004db52"
I20251215 20:54:44.436606 5558 raft_consensus.cc:3055] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Stepping down as leader of term 2
I20251215 20:54:44.436627 5711 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dff425fa89ff4eb5bb324154298bfd5d" candidate_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b"
I20251215 20:54:44.436951 5558 raft_consensus.cc:740] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ac534568c51434db437a84eb004db52, State: Running, Role: LEADER
I20251215 20:54:44.437251 5711 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:44.437752 5558 consensus_queue.cc:260] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.439090 5558 raft_consensus.cc:3060] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Advancing to term 3
I20251215 20:54:44.442233 5711 raft_consensus.cc:2468] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 3.
I20251215 20:54:44.443050 5602 leader_election.cc:304] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ede15f5ea3a24a58a56e8caebd2dc41b, f13926e3f3cd4a85998b5d16f2bc85ed; no voters:
I20251215 20:54:44.443603 6032 raft_consensus.cc:2804] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Leader election won for term 3
I20251215 20:54:44.443956 6032 raft_consensus.cc:697] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 LEADER]: Becoming Leader. State: Replica: f13926e3f3cd4a85998b5d16f2bc85ed, State: Running, Role: LEADER
I20251215 20:54:44.444772 6032 consensus_queue.cc:237] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } }
I20251215 20:54:44.446099 5558 raft_consensus.cc:2468] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f13926e3f3cd4a85998b5d16f2bc85ed in term 3.
I20251215 20:54:44.452549 5458 catalog_manager.cc:5654] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed reported cstate change: term changed from 2 to 3, leader changed from 9ac534568c51434db437a84eb004db52 (127.0.106.129) to f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130). New cstate: current_term: 3 leader_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 } health_report { overall_health: UNKNOWN } } }
I20251215 20:54:44.573271 5558 raft_consensus.cc:1275] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:54:44.574483 6044 consensus_queue.cc:1048] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:44.576992 5560 raft_consensus.cc:1275] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20251215 20:54:44.579241 6017 consensus_queue.cc:1048] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:44.586483 5635 raft_consensus.cc:1275] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251215 20:54:44.587642 6040 consensus_queue.cc:1048] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251215 20:54:44.609660 5634 raft_consensus.cc:1275] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Refusing update from remote peer ede15f5ea3a24a58a56e8caebd2dc41b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20251215 20:54:44.609998 5634 pending_rounds.cc:85] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: Aborting all ops after (but not including) 3
I20251215 20:54:44.610199 5634 pending_rounds.cc:107] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20251215 20:54:44.610409 5634 raft_consensus.cc:2889] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 20:54:44.611773 6040 consensus_queue.cc:1048] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13926e3f3cd4a85998b5d16f2bc85ed" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251215 20:54:45.016880 5711 raft_consensus.cc:1275] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:45.018052 6073 consensus_queue.cc:1048] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ede15f5ea3a24a58a56e8caebd2dc41b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251215 20:54:45.026139 5558 raft_consensus.cc:1275] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Refusing update from remote peer f13926e3f3cd4a85998b5d16f2bc85ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251215 20:54:45.027720 6073 consensus_queue.cc:1048] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac534568c51434db437a84eb004db52" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:593: Failure
Expected equality of these values:
leader.second
Which is: 4
3
I20251215 20:54:45.179554 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
I20251215 20:54:45.206354 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:45.207123 426 tablet_replica.cc:333] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.208164 426 raft_consensus.cc:2243] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.208684 426 raft_consensus.cc:2272] T 339ca3e921e1499883173b6f68571fce P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.211534 426 tablet_replica.cc:333] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.212170 426 raft_consensus.cc:2243] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.212620 426 raft_consensus.cc:2272] T 43a1d5d92b924a2abdb9b294d761286c P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.215544 426 tablet_replica.cc:333] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.216478 426 raft_consensus.cc:2243] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.217223 426 raft_consensus.cc:2272] T 89c46b4c730d41b7b4ba730a23092be2 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.219098 426 tablet_replica.cc:333] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.219604 426 raft_consensus.cc:2243] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.220209 426 raft_consensus.cc:2272] T f267b5f2804642939f1b2cb3c4c54545 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.222298 426 tablet_replica.cc:333] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.222764 426 raft_consensus.cc:2243] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.223119 426 raft_consensus.cc:2272] T ef3e90b779264349adea5ecfa16f0925 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.225075 426 tablet_replica.cc:333] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.225605 426 raft_consensus.cc:2243] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.226033 426 raft_consensus.cc:2272] T 994f1a59a8c54245bfbd9100395e6a41 P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.227988 426 tablet_replica.cc:333] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.228555 426 raft_consensus.cc:2243] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.228931 426 raft_consensus.cc:2272] T 79da44dccd03456b9a38946441f0bc30 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.231078 426 tablet_replica.cc:333] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.231642 426 raft_consensus.cc:2243] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.232242 426 raft_consensus.cc:2272] T b9bcb474df1d47db9f8c873f18d61aa0 P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:45.232484 5674 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20251215 20:54:45.235002 426 tablet_replica.cc:333] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52: stopping tablet replica
W20251215 20:54:45.235265 5674 consensus_peers.cc:597] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b -> Peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Couldn't send request to peer 9ac534568c51434db437a84eb004db52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:45.235967 426 raft_consensus.cc:2243] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.236764 426 raft_consensus.cc:2272] T 6705aa242e244c4ca9502545a1a8465a P 9ac534568c51434db437a84eb004db52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.238632 426 tablet_replica.cc:333] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.239140 426 raft_consensus.cc:2243] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.239490 426 raft_consensus.cc:2272] T dff425fa89ff4eb5bb324154298bfd5d P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.241497 426 tablet_replica.cc:333] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.241976 426 raft_consensus.cc:2243] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.242333 426 raft_consensus.cc:2272] T 462e94dfc865452fa0db5814f01e7001 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.244165 426 tablet_replica.cc:333] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.244658 426 raft_consensus.cc:2243] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.245421 426 raft_consensus.cc:2272] T 49cc5941ee674923ac97bde1cb66b06f P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.247361 426 tablet_replica.cc:333] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.247826 426 raft_consensus.cc:2243] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.248231 426 raft_consensus.cc:2272] T 4c4ee2039d89423297fedad862ed6c83 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.250296 426 tablet_replica.cc:333] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.250773 426 raft_consensus.cc:2243] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.251150 426 raft_consensus.cc:2272] T 9095c04828a243cf986895f9ad500b4c P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.253221 426 tablet_replica.cc:333] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.253770 426 raft_consensus.cc:2243] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.254401 426 raft_consensus.cc:2272] T d4432e6787ca40df96ccb85f083448a1 P 9ac534568c51434db437a84eb004db52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.256397 426 tablet_replica.cc:333] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.256834 426 raft_consensus.cc:2243] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.257542 426 raft_consensus.cc:2272] T b80e077e39454d528d3529f61a99d59f P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.259209 426 tablet_replica.cc:333] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.259634 426 raft_consensus.cc:2243] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.260120 426 raft_consensus.cc:2272] T 73a5617219cb4d54a353faa8c01e1d00 P 9ac534568c51434db437a84eb004db52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.261842 426 tablet_replica.cc:333] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52: stopping tablet replica
I20251215 20:54:45.262240 426 raft_consensus.cc:2243] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.262620 426 raft_consensus.cc:2272] T c13de8b1518d44739e99be20483c275b P 9ac534568c51434db437a84eb004db52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.300833 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20251215 20:54:45.307538 5674 consensus_peers.cc:597] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b -> Peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Couldn't send request to peer 9ac534568c51434db437a84eb004db52. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:45.308014 5674 consensus_peers.cc:597] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b -> Peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Couldn't send request to peer 9ac534568c51434db437a84eb004db52. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:45.318599 5600 consensus_peers.cc:597] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed -> Peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Couldn't send request to peer 9ac534568c51434db437a84eb004db52. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:45.336016 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
I20251215 20:54:45.361316 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:45.361967 426 tablet_replica.cc:333] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.362704 426 raft_consensus.cc:2243] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.363243 426 raft_consensus.cc:2272] T 43a1d5d92b924a2abdb9b294d761286c P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.365343 426 tablet_replica.cc:333] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.365864 426 raft_consensus.cc:2243] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.366269 426 raft_consensus.cc:2272] T 339ca3e921e1499883173b6f68571fce P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.368474 426 tablet_replica.cc:333] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.368978 426 raft_consensus.cc:2243] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.369374 426 raft_consensus.cc:2272] T f267b5f2804642939f1b2cb3c4c54545 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.371104 426 tablet_replica.cc:333] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.371634 426 raft_consensus.cc:2243] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.372028 426 raft_consensus.cc:2272] T 89c46b4c730d41b7b4ba730a23092be2 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.374032 426 tablet_replica.cc:333] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.374501 426 raft_consensus.cc:2243] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.374872 426 raft_consensus.cc:2272] T d4432e6787ca40df96ccb85f083448a1 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.376713 426 tablet_replica.cc:333] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.377182 426 raft_consensus.cc:2243] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.377565 426 raft_consensus.cc:2272] T 49cc5941ee674923ac97bde1cb66b06f P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.379384 426 tablet_replica.cc:333] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.379853 426 raft_consensus.cc:2243] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.380244 426 raft_consensus.cc:2272] T 462e94dfc865452fa0db5814f01e7001 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.382035 426 tablet_replica.cc:333] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.382519 426 raft_consensus.cc:2243] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.382895 426 raft_consensus.cc:2272] T 4c4ee2039d89423297fedad862ed6c83 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.384603 426 tablet_replica.cc:333] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.385077 426 raft_consensus.cc:2243] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.385447 426 raft_consensus.cc:2272] T 9095c04828a243cf986895f9ad500b4c P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.387638 426 tablet_replica.cc:333] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.388108 426 raft_consensus.cc:2243] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.388823 426 raft_consensus.cc:2272] T ef3e90b779264349adea5ecfa16f0925 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.390580 426 tablet_replica.cc:333] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.391049 426 raft_consensus.cc:2243] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.391804 426 raft_consensus.cc:2272] T 994f1a59a8c54245bfbd9100395e6a41 P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.393774 426 tablet_replica.cc:333] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.394385 426 raft_consensus.cc:2243] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.394876 426 raft_consensus.cc:2272] T 79da44dccd03456b9a38946441f0bc30 P f13926e3f3cd4a85998b5d16f2bc85ed [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:45.397083 5674 consensus_peers.cc:597] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b -> Peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Couldn't send request to peer 9ac534568c51434db437a84eb004db52. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:45.397372 426 tablet_replica.cc:333] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.397928 426 raft_consensus.cc:2243] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.398312 426 raft_consensus.cc:2272] T b9bcb474df1d47db9f8c873f18d61aa0 P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.400162 426 tablet_replica.cc:333] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.400714 426 raft_consensus.cc:2243] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.401188 426 raft_consensus.cc:2272] T 6705aa242e244c4ca9502545a1a8465a P f13926e3f3cd4a85998b5d16f2bc85ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:45.402673 5674 consensus_peers.cc:597] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b -> Peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Couldn't send request to peer 9ac534568c51434db437a84eb004db52. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:45.403290 426 tablet_replica.cc:333] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.403834 426 raft_consensus.cc:2243] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.404554 426 raft_consensus.cc:2272] T dff425fa89ff4eb5bb324154298bfd5d P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.406638 426 tablet_replica.cc:333] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.407065 426 raft_consensus.cc:2243] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.407469 426 raft_consensus.cc:2272] T b80e077e39454d528d3529f61a99d59f P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.409246 426 tablet_replica.cc:333] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.409662 426 raft_consensus.cc:2243] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.410367 426 raft_consensus.cc:2272] T 73a5617219cb4d54a353faa8c01e1d00 P f13926e3f3cd4a85998b5d16f2bc85ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.412194 426 tablet_replica.cc:333] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed: stopping tablet replica
I20251215 20:54:45.412642 426 raft_consensus.cc:2243] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.413051 426 raft_consensus.cc:2272] T c13de8b1518d44739e99be20483c275b P f13926e3f3cd4a85998b5d16f2bc85ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.448225 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
I20251215 20:54:45.476816 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
I20251215 20:54:45.500274 426 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251215 20:54:45.500986 426 tablet_replica.cc:333] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.501694 426 raft_consensus.cc:2243] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.502130 426 raft_consensus.cc:2272] T 994f1a59a8c54245bfbd9100395e6a41 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.504155 426 tablet_replica.cc:333] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.504711 426 raft_consensus.cc:2243] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.505357 426 raft_consensus.cc:2272] T 79da44dccd03456b9a38946441f0bc30 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.507383 426 tablet_replica.cc:333] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.507915 426 raft_consensus.cc:2243] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.508584 426 raft_consensus.cc:2272] T 339ca3e921e1499883173b6f68571fce P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.510324 426 tablet_replica.cc:333] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.510771 426 raft_consensus.cc:2243] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.511430 426 raft_consensus.cc:2272] T 43a1d5d92b924a2abdb9b294d761286c P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.513254 426 tablet_replica.cc:333] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.513700 426 raft_consensus.cc:2243] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.514062 426 raft_consensus.cc:2272] T 89c46b4c730d41b7b4ba730a23092be2 P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.515656 426 tablet_replica.cc:333] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.516086 426 raft_consensus.cc:2243] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.516453 426 raft_consensus.cc:2272] T f267b5f2804642939f1b2cb3c4c54545 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.518200 426 tablet_replica.cc:333] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.518659 426 raft_consensus.cc:2243] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.519111 426 raft_consensus.cc:2272] T b80e077e39454d528d3529f61a99d59f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.521008 426 tablet_replica.cc:333] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.521479 426 raft_consensus.cc:2243] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.521879 426 raft_consensus.cc:2272] T 73a5617219cb4d54a353faa8c01e1d00 P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.523607 426 tablet_replica.cc:333] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.524096 426 raft_consensus.cc:2243] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.524816 426 raft_consensus.cc:2272] T c13de8b1518d44739e99be20483c275b P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.526386 426 tablet_replica.cc:333] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.526855 426 raft_consensus.cc:2243] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.527192 426 raft_consensus.cc:2272] T ef3e90b779264349adea5ecfa16f0925 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.529152 426 tablet_replica.cc:333] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.529898 426 raft_consensus.cc:2243] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.530426 426 raft_consensus.cc:2272] T 6705aa242e244c4ca9502545a1a8465a P ede15f5ea3a24a58a56e8caebd2dc41b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.532876 426 tablet_replica.cc:333] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.533406 426 raft_consensus.cc:2243] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.533823 426 raft_consensus.cc:2272] T dff425fa89ff4eb5bb324154298bfd5d P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.536270 426 tablet_replica.cc:333] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.537019 426 raft_consensus.cc:2243] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.537940 426 raft_consensus.cc:2272] T 462e94dfc865452fa0db5814f01e7001 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Raft consensus is shut down!
W20251215 20:54:45.538246 5675 consensus_peers.cc:597] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b -> Peer f13926e3f3cd4a85998b5d16f2bc85ed (127.0.106.130:34951): Couldn't send request to peer f13926e3f3cd4a85998b5d16f2bc85ed. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251215 20:54:45.539525 5674 consensus_peers.cc:597] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b -> Peer 9ac534568c51434db437a84eb004db52 (127.0.106.129:37493): Couldn't send request to peer 9ac534568c51434db437a84eb004db52. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 20:54:45.539923 426 tablet_replica.cc:333] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.540505 426 raft_consensus.cc:2243] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.540925 426 raft_consensus.cc:2272] T 49cc5941ee674923ac97bde1cb66b06f P ede15f5ea3a24a58a56e8caebd2dc41b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.542687 426 tablet_replica.cc:333] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.543126 426 raft_consensus.cc:2243] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.543774 426 raft_consensus.cc:2272] T b9bcb474df1d47db9f8c873f18d61aa0 P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.545533 426 tablet_replica.cc:333] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.545964 426 raft_consensus.cc:2243] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Raft consensus shutting down.
I20251215 20:54:45.546689 426 raft_consensus.cc:2272] T d4432e6787ca40df96ccb85f083448a1 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.548391 426 tablet_replica.cc:333] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.548818 426 raft_consensus.cc:2243] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.549444 426 raft_consensus.cc:2272] T 4c4ee2039d89423297fedad862ed6c83 P ede15f5ea3a24a58a56e8caebd2dc41b [term 4 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.551059 426 tablet_replica.cc:333] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b: stopping tablet replica
I20251215 20:54:45.551501 426 raft_consensus.cc:2243] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.552145 426 raft_consensus.cc:2272] T 9095c04828a243cf986895f9ad500b4c P ede15f5ea3a24a58a56e8caebd2dc41b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.602639 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20251215 20:54:45.630622 426 master.cc:561] Master@127.0.106.190:41463 shutting down...
I20251215 20:54:45.649932 426 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 1 LEADER]: Raft consensus shutting down.
I20251215 20:54:45.650415 426 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 20:54:45.650714 426 tablet_replica.cc:333] T 00000000000000000000000000000000 P d8ffa91dd7a14edf9b0fd9d4c6df5e57: stopping tablet replica
I20251215 20:54:45.685770 426 master.cc:583] Master@127.0.106.190:41463 shutdown complete.
I20251215 20:54:45.714004 426 test_util.cc:183] -----------------------------------------------
I20251215 20:54:45.714182 426 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskkqR61j/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1765831869714107-426-0
[ FAILED ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true (21369 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41289 ms total)
[----------] Global test environment tear-down
[==========] 7 tests from 2 test suites ran. (215846 ms total)
[ PASSED ] 4 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[ FAILED ] 2 tests, listed below:
[ FAILED ] LeaderRebalancerTest.AddTserver
[ FAILED ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true
2 FAILED TESTS
I20251215 20:54:45.721019 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2289 messages since previous log ~365 seconds ago
I20251215 20:54:45.721215 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2292 messages since previous log ~365 seconds ago
I20251215 20:54:45.721375 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2292 messages since previous log ~365 seconds ago
I20251215 20:54:45.721570 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 44 messages since previous log ~58 seconds ago
I20251215 20:54:45.721740 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 44 messages since previous log ~58 seconds ago
I20251215 20:54:45.721915 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:4712: suppressed but not reported on 1 messages since previous log ~71 seconds ago
I20251215 20:54:45.722148 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20251215 20:54:45.722419 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2378: suppressed but not reported on 80 messages since previous log ~36 seconds ago